Aug 16 14:55:51 user nova-compute[73091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 14:55:54 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73091) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73091) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73091) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 14:55:54 user nova-compute[73091]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 14:55:54 user nova-compute[73091]: INFO nova.virt.driver [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 14:55:54 user nova-compute[73091]: INFO nova.compute.provider_config [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Acquiring lock "singleton_lock" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Acquired lock "singleton_lock" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Releasing lock "singleton_lock" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Full set of CONF: {{(pid=73091) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ******************************************************************************** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Configuration options gathered from: {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ================================================================================ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] allow_resize_to_same_host      = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] arq_binding_timeout            = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] backdoor_port                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] backdoor_socket                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] block_device_allocate_retries  = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] block_device_allocate_retries_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cert                           = self.pem {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute_monitors               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] config_dir                     = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] config_drive_format            = iso9660 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] config_source                  = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] console_host                   = user {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] control_exchange               = nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cpu_allocation_ratio           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] daemon                         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] debug                          = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] default_access_ip_network_name = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] default_availability_zone      = nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] default_ephemeral_format       = ext4 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] default_schedule_zone          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] disk_allocation_ratio          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] enable_new_services            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] enabled_ssl_apis               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] flat_injected                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] force_config_drive             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] force_raw_images               = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] graceful_shutdown_timeout      = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] heal_instance_info_cache_interval = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] host                           = user {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_build_timeout         = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_delete_interval       = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_name_template         = instance-%08x {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_usage_audit           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_usage_audit_period    = month {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] internal_service_availability_zone = internal {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] key                            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] live_migration_retry_count     = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_config_append              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_dir                        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_file                       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_options                    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_rotate_interval            = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_rotate_interval_type       = days {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] log_rotation_type              = none {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] long_rpc_timeout               = 1800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] max_concurrent_builds          = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] max_concurrent_live_migrations = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] max_concurrent_snapshots       = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] max_local_block_devices        = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] max_logfile_count              = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] max_logfile_size_mb            = 200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] maximum_instance_delete_attempts = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metadata_listen                = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metadata_listen_port           = 8775 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metadata_workers               = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] migrate_max_retries            = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] mkisofs_cmd                    = genisoimage {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] my_ip                          = 10.0.0.210 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] network_allocate_retries       = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] osapi_compute_listen_port      = 8774 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] osapi_compute_unique_server_name_scope =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] osapi_compute_workers          = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] password_length                = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] periodic_enable                = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] periodic_fuzzy_delay           = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] pointer_model                  = ps2mouse {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] preallocate_images             = none {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] publish_errors                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] pybasedir                      = /opt/stack/nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ram_allocation_ratio           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rate_limit_burst               = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rate_limit_except_level        = CRITICAL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rate_limit_interval            = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reboot_timeout                 = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reclaim_instance_interval      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] record                         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reimage_timeout_per_gb         = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] report_interval                = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rescue_timeout                 = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reserved_host_cpus             = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reserved_host_disk_mb          = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reserved_host_memory_mb        = 512 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] reserved_huge_pages            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] resize_confirm_window          = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] resize_fs_using_block_device   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] resume_guests_state_on_host_boot = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rpc_response_timeout           = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] run_external_periodic_tasks    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] running_deleted_instance_action = reap {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] running_deleted_instance_timeout = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler_instance_sync_interval = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_down_time              = 720 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] servicegroup_driver            = db {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] shelved_offload_time           = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] shelved_poll_interval          = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] shutdown_timeout               = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] source_is_ipv6                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ssl_only                       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] state_path                     = /opt/stack/data/nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] sync_power_state_interval      = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] sync_power_state_pool_size     = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] syslog_log_facility            = LOG_USER {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] tempdir                        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] timeout_nbd                    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] transport_url                  = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] update_resources_interval      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_cow_images                 = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_eventlog                   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_journal                    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_json                       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_rootwrap_daemon            = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_stderr                     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] use_syslog                     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vcpu_pin_set                   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plugging_is_fatal          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plugging_timeout           = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] virt_mkfs                      = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] volume_usage_poll_interval     = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] watch_log_file                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] web                            = /usr/share/spice-html5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.auth_strategy              = keystone {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.compute_link_prefix        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.dhcp_domain                = novalocal {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.enable_instance_password   = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.glance_link_prefix         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.instance_list_per_project_cells = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.list_records_by_skipping_down_cells = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.local_metadata_per_cell    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.max_limit                  = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.metadata_cache_expiration  = 15 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.neutron_default_tenant_id  = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.use_forwarded_for          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.use_neutron_default_nets   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_dynamic_targets = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_jsonfile_path   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.backend_argument         = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.config_prefix            = cache.oslo {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.dead_timeout             = 60.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.debug_cache_backend      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.enable_retry_client      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.enable_socket_keepalive  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.enabled                  = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.expiration_time          = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_dead_retry      = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_password        =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_sasl_enabled    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.memcache_username        =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.proxies                  = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.retry_attempts           = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.retry_delay              = 0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.socket_keepalive_count   = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.socket_keepalive_idle    = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.socket_keepalive_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.tls_allowed_ciphers      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.tls_cafile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.tls_certfile             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.tls_enabled              = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cache.tls_keyfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.auth_section            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.auth_type               = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.cross_az_attach         = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.debug                   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.endpoint_template       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.http_retries            = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.os_region_name          = RegionOne {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cinder.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.cpu_dedicated_set      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.cpu_shared_set         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.image_type_exclude_list = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.resource_provider_association_refresh = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.shutdown_retry_interval = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] conductor.workers              = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] console.allowed_origins        = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] console.ssl_ciphers            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] console.ssl_minimum_version    = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] consoleauth.token_ttl          = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.connect_retries         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.connect_retry_delay     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.endpoint_override       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.max_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.min_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.region_name             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.service_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.service_type            = accelerator {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.status_code_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] cyborg.version                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.backend               = sqlalchemy {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.connection            = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.connection_debug      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.connection_parameters =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.connection_recycle_time = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.connection_trace      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.db_inc_retry_interval = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.db_max_retries        = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.db_max_retry_interval = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.db_retry_interval     = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.max_overflow          = 50 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.max_pool_size         = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.max_retries           = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.mysql_enable_ndb      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.pool_timeout          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.retry_interval        = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.slave_connection      = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] database.sqlite_synchronous    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.backend           = sqlalchemy {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.connection        = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.connection_debug  = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.connection_parameters =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.connection_recycle_time = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.connection_trace  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.db_inc_retry_interval = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.db_max_retries    = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.db_max_retry_interval = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.db_retry_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.max_overflow      = 50 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.max_pool_size     = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.max_retries       = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.mysql_enable_ndb  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.pool_timeout      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.retry_interval    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.slave_connection  = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] api_database.sqlite_synchronous = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] devices.enabled_mdev_types     = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ephemeral_storage_encryption.enabled = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.api_servers             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.connect_retries         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.connect_retry_delay     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.debug                   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.default_trusted_certificate_ids = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.enable_certificate_validation = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.enable_rbd_download     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.endpoint_override       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.max_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.min_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.num_retries             = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.rbd_ceph_conf           =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.rbd_connect_timeout     = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.rbd_pool                =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.rbd_user                =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.region_name             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.service_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.service_type            = image {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.status_code_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.verify_glance_signatures = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] glance.version                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] guestfs.debug                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.config_drive_cdrom      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.config_drive_inject_password = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.enable_remotefx         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.instances_path_share    =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.limit_cpu_features      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.use_multipath_io        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.vswitch_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] mks.enabled                    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] image_cache.manager_interval   = 2400 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] image_cache.precache_concurrency = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] image_cache.remove_unused_base_images = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] image_cache.subdirectory_name  = _base {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.api_max_retries         = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.api_retry_interval      = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.auth_section            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.auth_type               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.connect_retries         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.connect_retry_delay     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.endpoint_override       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.max_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.min_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.partition_key           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.peer_list               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.region_name             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.serial_console_state_timeout = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.service_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.service_type            = baremetal {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.status_code_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ironic.version                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] key_manager.fixed_key          = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.barbican_api_version  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.barbican_endpoint     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.barbican_endpoint_type = public {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.barbican_region_name  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.cafile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.certfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.collect_timing        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.insecure              = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.keyfile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.number_of_retries     = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.retry_delay           = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.send_service_user_token = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.split_loggers         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.timeout               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.verify_ssl            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican.verify_ssl_path       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.auth_section = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.auth_type = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.cafile   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.certfile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.collect_timing = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.insecure = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.keyfile  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.split_loggers = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] barbican_service_user.timeout  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.approle_role_id          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.approle_secret_id        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.cafile                   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.certfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.collect_timing           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.insecure                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.keyfile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.kv_mountpoint            = secret {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.kv_version               = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.namespace                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.root_token_id            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.split_loggers            = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.ssl_ca_crt_file          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.timeout                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.use_ssl                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.cafile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.certfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.collect_timing        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.connect_retries       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.connect_retry_delay   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.endpoint_override     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.insecure              = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.keyfile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.max_version           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.min_version           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.region_name           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.service_name          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.service_type          = identity {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.split_loggers         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.status_code_retries   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.timeout               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] keystone.version               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.connection_uri         =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_mode               = custom {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: WARNING oslo_config.cfg [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_power_governor_high = performance {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_power_management   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.device_detach_attempts = 8 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.device_detach_timeout  = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.disk_cachemodes        = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.disk_prefix            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.enabled_perf_events    = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.file_backed_memory     = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.gid_maps               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.hw_disk_discard        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.hw_machine_type        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_rbd_pool        = rbd {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_type            = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.images_volume_group    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.inject_key             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.inject_partition       = -2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.inject_password        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.iscsi_iface            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.iser_use_multipath     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_downtime = 500 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_inbound_addr = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_scheme  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_timeout_action = abort {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_tunnelled = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: WARNING oslo_config.cfg [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 14:55:54 user nova-compute[73091]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 14:55:54 user nova-compute[73091]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 14:55:54 user nova-compute[73091]: and ``live_migration_inbound_addr`` respectively.
Aug 16 14:55:54 user nova-compute[73091]: ).  Its value may be silently ignored in the future.
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.live_migration_with_native_tls = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.max_queues             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.nfs_mount_options      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.num_pcie_ports         = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.pmem_namespaces        = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.quobyte_client_cfg     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rbd_secret_uuid        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rbd_user               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rescue_image_id        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rescue_kernel_id       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.rx_queue_size          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.smbfs_mount_options    =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.snapshot_compression   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.snapshot_image_format  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.sparse_logical_volumes = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.swtpm_enabled          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.swtpm_group            = tss {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.swtpm_user             = tss {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.sysinfo_serial         = unique {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.tb_cache_size          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.tx_queue_size          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.uid_maps               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.use_virtio_for_bridges = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.virt_type              = kvm {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.volume_clear           = zero {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.volume_clear_size      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.volume_use_multipath   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_cache_path   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.auth_section           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.auth_type              = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.cafile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.certfile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.collect_timing         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.connect_retries        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.connect_retry_delay    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.default_floating_pool  = public {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.endpoint_override      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.extension_sync_interval = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.http_retries           = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.insecure               = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.keyfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.max_version            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.min_version            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.ovs_bridge             = br-int {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.physnets               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.region_name            = RegionOne {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.service_metadata_proxy = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.service_name           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.service_type           = network {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.split_loggers          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.status_code_retries    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.timeout                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] neutron.version                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] notifications.bdms_in_notifications = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] notifications.default_level    = INFO {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] notifications.notification_format = unversioned {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] notifications.notify_on_state_change = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] pci.alias                      = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] pci.device_spec                = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] pci.report_in_placement        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.auth_section         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.auth_type            = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.cafile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.certfile             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.collect_timing       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.connect_retries      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.connect_retry_delay  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.default_domain_id    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.default_domain_name  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.domain_id            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.domain_name          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.endpoint_override    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.insecure             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.keyfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.max_version          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.min_version          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.password             = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.project_domain_id    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.project_domain_name  = Default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.project_id           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.project_name         = service {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.region_name          = RegionOne {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.service_name         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.service_type         = placement {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.split_loggers        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.status_code_retries  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.system_scope         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.timeout              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.trust_id             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.user_domain_id       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.user_domain_name     = Default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.user_id              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.username             = placement {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] placement.version              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.cores                    = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.count_usage_from_placement = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.injected_file_content_bytes = 10240 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.injected_file_path_length = 255 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.injected_files           = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.instances                = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.key_pairs                = 100 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.metadata_items           = 128 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.ram                      = 51200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.recheck_quota            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.server_group_members     = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] quota.server_groups            = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rdp.enabled                    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.image_metadata_prefilter = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.max_attempts         = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.max_placement_results = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] scheduler.workers              = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.host_subset_size = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.isolated_hosts = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.isolated_images = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.pci_in_placement = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.track_instance_changes = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metrics.required               = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metrics.weight_multiplier      = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] metrics.weight_setting         = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] serial_console.enabled         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] serial_console.port_range      = 10000:20000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] serial_console.serialproxy_port = 6083 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.auth_section      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.auth_type         = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.cafile            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.certfile          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.collect_timing    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.insecure          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.keyfile           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.send_service_user_token = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.split_loggers     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] service_user.timeout           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.agent_enabled            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.enabled                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.html5proxy_port          = 6082 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.image_compression        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.jpeg_compression         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.playback_compression     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.server_listen            = 127.0.0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.streaming_mode           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] spice.zlib_compression         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] upgrade_levels.baseapi         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] upgrade_levels.cert            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] upgrade_levels.compute         = auto {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] upgrade_levels.conductor       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] upgrade_levels.scheduler       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.cafile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.certfile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.insecure = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vendordata_dynamic_auth.timeout = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.api_retry_count         = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.ca_file                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.cache_prefix            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.cluster_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.connection_pool_size    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.console_delay_seconds   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.datastore_regex         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.host_ip                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.host_password           = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.host_port               = 443 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.host_username           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.integration_bridge      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.maximum_objects         = 100 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.pbm_default_policy      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.pbm_enabled             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.pbm_wsdl_location       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.serial_port_proxy_uri   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.serial_port_service_uri = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.task_poll_interval      = 0.5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.use_linked_clone        = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.vnc_keymap              = en-us {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.vnc_port                = 5900 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vmware.vnc_port_total          = 10000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.auth_schemes               = ['none'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.enabled                    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.novncproxy_port            = 6080 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.vencrypt_ca_certs          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.vencrypt_client_cert       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vnc.vencrypt_client_key        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:54 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.disable_rootwrap   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.enable_numa_live_migration = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.libvirt_disable_apic = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.client_socket_timeout     = 900 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.default_pool_size         = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.keep_alive                = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.max_header_line           = 16384 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.ssl_ca_file               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.ssl_cert_file             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.ssl_key_file              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.tcp_keepidle              = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] zvm.ca_file                    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] zvm.cloud_connector_url        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] zvm.reachable_timeout          = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.enforce_scope      = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.policy_default_rule = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.connection_string     = messaging:// {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.enabled               = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.es_doc_type           = notification {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.es_scroll_size        = 10000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.es_scroll_time        = 2m {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.filter_error_trace    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.hmac_keys             = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.sentinel_service_name = mymaster {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.socket_timeout        = 0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.trace_requests        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler.trace_sqlalchemy      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler_jaeger.process_tags   = {} {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] profiler_otlp.service_name_prefix = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] remote_debug.host              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] remote_debug.port              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.auth_section        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.auth_type           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.cafile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.certfile            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.collect_timing      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.connect_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.connect_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.endpoint_id         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.endpoint_override   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.insecure            = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.keyfile             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.max_version         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.min_version         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.region_name         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.service_name        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.service_type        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.split_loggers       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.status_code_retries = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.timeout             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.valid_interfaces    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_limit.version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_reports.file_event_handler = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] oslo_reports.log_dir           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_ovs_privileged.group  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] vif_plug_ovs_privileged.user   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_ovs.isolate_vif         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] os_brick.lock_path             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] privsep_osbrick.capabilities   = [21] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] privsep_osbrick.group          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] privsep_osbrick.helper_command = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] privsep_osbrick.user           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] nova_sys_admin.group           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] nova_sys_admin.helper_command  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] nova_sys_admin.user            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-9ba16242-f187-4ec8-b083-9c4b02c5d5b2 None None] ******************************************************************************** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 14:55:55 user nova-compute[73091]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Starting native event thread {{(pid=73091) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Starting green dispatch thread {{(pid=73091) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Starting connection event dispatch thread {{(pid=73091) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Connecting to libvirt: qemu:///system {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f11549f4eb0> {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f11549f4eb0> {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 14:55:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Connection event '1' reason 'None'
Aug 16 14:55:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 14:55:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.mount [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Initialising _HostMountState generation 0 {{(pid=73091) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 14:56:02 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host capabilities <capabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <host>
Aug 16 14:56:02 user nova-compute[73091]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 14:56:02 user nova-compute[73091]:     <cpu>
Aug 16 14:56:02 user nova-compute[73091]:       <arch>x86_64</arch>
Aug 16 14:56:02 user nova-compute[73091]:       <model>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <microcode version='1070'/>
Aug 16 14:56:02 user nova-compute[73091]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='osxsave'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='invtsc'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='rsba'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 14:56:02 user nova-compute[73091]:       <pages unit='KiB' size='4'/>
Aug 16 14:56:02 user nova-compute[73091]:       <pages unit='KiB' size='2048'/>
Aug 16 14:56:02 user nova-compute[73091]:     </cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <power_management>
Aug 16 14:56:02 user nova-compute[73091]:       <suspend_mem/>
Aug 16 14:56:02 user nova-compute[73091]:       <suspend_disk/>
Aug 16 14:56:02 user nova-compute[73091]:       <suspend_hybrid/>
Aug 16 14:56:02 user nova-compute[73091]:     </power_management>
Aug 16 14:56:02 user nova-compute[73091]:     <iommu support='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <migration_features>
Aug 16 14:56:02 user nova-compute[73091]:       <live/>
Aug 16 14:56:02 user nova-compute[73091]:       <uri_transports>
Aug 16 14:56:02 user nova-compute[73091]:         <uri_transport>tcp</uri_transport>
Aug 16 14:56:02 user nova-compute[73091]:         <uri_transport>rdma</uri_transport>
Aug 16 14:56:02 user nova-compute[73091]:       </uri_transports>
Aug 16 14:56:02 user nova-compute[73091]:     </migration_features>
Aug 16 14:56:02 user nova-compute[73091]:     <topology>
Aug 16 14:56:02 user nova-compute[73091]:       <cells num='2'>
Aug 16 14:56:02 user nova-compute[73091]:         <cell id='0'>
Aug 16 14:56:02 user nova-compute[73091]:           <memory unit='KiB'>8140616</memory>
Aug 16 14:56:02 user nova-compute[73091]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 16 14:56:02 user nova-compute[73091]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 14:56:02 user nova-compute[73091]:           <distances>
Aug 16 14:56:02 user nova-compute[73091]:             <sibling id='0' value='10'/>
Aug 16 14:56:02 user nova-compute[73091]:             <sibling id='1' value='20'/>
Aug 16 14:56:02 user nova-compute[73091]:           </distances>
Aug 16 14:56:02 user nova-compute[73091]:           <cpus num='6'>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 14:56:02 user nova-compute[73091]:           </cpus>
Aug 16 14:56:02 user nova-compute[73091]:         </cell>
Aug 16 14:56:02 user nova-compute[73091]:         <cell id='1'>
Aug 16 14:56:02 user nova-compute[73091]:           <memory unit='KiB'>8255100</memory>
Aug 16 14:56:02 user nova-compute[73091]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 16 14:56:02 user nova-compute[73091]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 14:56:02 user nova-compute[73091]:           <distances>
Aug 16 14:56:02 user nova-compute[73091]:             <sibling id='0' value='20'/>
Aug 16 14:56:02 user nova-compute[73091]:             <sibling id='1' value='10'/>
Aug 16 14:56:02 user nova-compute[73091]:           </distances>
Aug 16 14:56:02 user nova-compute[73091]:           <cpus num='6'>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 14:56:02 user nova-compute[73091]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 14:56:02 user nova-compute[73091]:           </cpus>
Aug 16 14:56:02 user nova-compute[73091]:         </cell>
Aug 16 14:56:02 user nova-compute[73091]:       </cells>
Aug 16 14:56:02 user nova-compute[73091]:     </topology>
Aug 16 14:56:02 user nova-compute[73091]:     <cache>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 14:56:02 user nova-compute[73091]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 14:56:02 user nova-compute[73091]:     </cache>
Aug 16 14:56:02 user nova-compute[73091]:     <secmodel>
Aug 16 14:56:02 user nova-compute[73091]:       <model>apparmor</model>
Aug 16 14:56:02 user nova-compute[73091]:       <doi>0</doi>
Aug 16 14:56:02 user nova-compute[73091]:     </secmodel>
Aug 16 14:56:02 user nova-compute[73091]:     <secmodel>
Aug 16 14:56:02 user nova-compute[73091]:       <model>dac</model>
Aug 16 14:56:02 user nova-compute[73091]:       <doi>0</doi>
Aug 16 14:56:02 user nova-compute[73091]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 14:56:02 user nova-compute[73091]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 14:56:02 user nova-compute[73091]:     </secmodel>
Aug 16 14:56:02 user nova-compute[73091]:   </host>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='alpha'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>clipper</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='armv6l'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='armv7l'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='aarch64'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='cris'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='i686'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>isapc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>microvm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='kvm'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <pae/>
Aug 16 14:56:02 user nova-compute[73091]:       <nonpae/>
Aug 16 14:56:02 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:       <apic default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='m68k'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>an5206</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>q800</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='microblaze'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='microblazeel'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='mips'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='mipsel'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='mips64'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>pica61</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>magnum</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='mips64el'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>pica61</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>magnum</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='16'>boston</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='ppc'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='ppc64'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='ppc64le'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='riscv32'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='8'>spike</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='8'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='riscv64'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='8'>spike</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='8'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='s390x'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='sh4'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>shix</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>r2d</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='sh4eb'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>shix</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>r2d</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='sparc'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>LX</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='sparc64'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>niagara</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='x86_64'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='1'>isapc</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>microvm</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='kvm'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:       <apic default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='xtensa'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>sim</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]:   <guest>
Aug 16 14:56:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 14:56:02 user nova-compute[73091]:     <arch name='xtensaeb'>
Aug 16 14:56:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 14:56:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='4'>sim</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>virt</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 14:56:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 14:56:02 user nova-compute[73091]:     </arch>
Aug 16 14:56:02 user nova-compute[73091]:     <features>
Aug 16 14:56:02 user nova-compute[73091]:       <cpuselection/>
Aug 16 14:56:02 user nova-compute[73091]:       <deviceboot/>
Aug 16 14:56:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     </features>
Aug 16 14:56:02 user nova-compute[73091]:   </guest>
Aug 16 14:56:02 user nova-compute[73091]: </capabilities>
Aug 16 14:56:02 user nova-compute[73091]: 
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-i440fx-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ide</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-q35-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-q35-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-i440fx-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ide</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-i440fx-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>efi</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ide</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-q35-jammy</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>efi</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-q35-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>efi</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 14:56:02 user nova-compute[73091]: <domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 14:56:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 14:56:02 user nova-compute[73091]:   <machine>pc-i440fx-6.2</machine>
Aug 16 14:56:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 14:56:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 14:56:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:   <os supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>efi</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>rom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pflash</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>yes</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='secure'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>no</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </loader>
Aug 16 14:56:02 user nova-compute[73091]:   </os>
Aug 16 14:56:02 user nova-compute[73091]:   <cpu>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>on</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>off</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 14:56:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 14:56:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 14:56:02 user nova-compute[73091]:     </mode>
Aug 16 14:56:02 user nova-compute[73091]:   </cpu>
Aug 16 14:56:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 14:56:02 user nova-compute[73091]:       <value>file</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 14:56:02 user nova-compute[73091]:       <value>memfd</value>
Aug 16 14:56:02 user nova-compute[73091]:     </enum>
Aug 16 14:56:02 user nova-compute[73091]:   </memoryBacking>
Aug 16 14:56:02 user nova-compute[73091]:   <devices>
Aug 16 14:56:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>disk</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>floppy</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>lun</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='bus'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ide</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>fdc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sata</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </disk>
Aug 16 14:56:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='type'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>sdl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vnc</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>spice</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </graphics>
Aug 16 14:56:02 user nova-compute[73091]:     <video supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>qxl</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>none</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>bochs</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </video>
Aug 16 14:56:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='mode'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>default</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>requisite</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>optional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>usb</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>pci</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>scsi</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 14:56:02 user nova-compute[73091]:     </hostdev>
Aug 16 14:56:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>random</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>egd</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>builtin</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </rng>
Aug 16 14:56:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>path</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>handle</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </filesystem>
Aug 16 14:56:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='model'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 14:56:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 14:56:02 user nova-compute[73091]:         <value>emulator</value>
Aug 16 14:56:02 user nova-compute[73091]:       </enum>
Aug 16 14:56:02 user nova-compute[73091]:     </tpm>
Aug 16 14:56:02 user nova-compute[73091]:   </devices>
Aug 16 14:56:02 user nova-compute[73091]:   <features>
Aug 16 14:56:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 14:56:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 14:56:02 user nova-compute[73091]:   </features>
Aug 16 14:56:02 user nova-compute[73091]: </domainCapabilities>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 14:56:02 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Secure Boot support detected
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] cpu compare xml: <cpu match="exact">
Aug 16 14:56:02 user nova-compute[73091]:   <model>Nehalem</model>
Aug 16 14:56:02 user nova-compute[73091]: </cpu>
Aug 16 14:56:02 user nova-compute[73091]:  {{(pid=73091) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 14:56:02 user nova-compute[73091]: INFO nova.virt.node [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Generated node identity de22140b-6a80-4bc1-99c6-0964e3f024fc
Aug 16 14:56:02 user nova-compute[73091]: INFO nova.virt.node [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Wrote node identity de22140b-6a80-4bc1-99c6-0964e3f024fc to /opt/stack/data/nova/compute_id
Aug 16 14:56:02 user nova-compute[73091]: WARNING nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Compute nodes ['de22140b-6a80-4bc1-99c6-0964e3f024fc'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 14:56:02 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 14:56:02 user nova-compute[73091]: WARNING nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 14:56:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:56:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 14:56:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:56:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Hypervisor/Node resource view: name=user free_ram=10920MB free_disk=26.383331298828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:56:03 user nova-compute[73091]: WARNING nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] No compute node record for user:de22140b-6a80-4bc1-99c6-0964e3f024fc: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host de22140b-6a80-4bc1-99c6-0964e3f024fc could not be found.
Aug 16 14:56:03 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Compute node record created for user:user with uuid: de22140b-6a80-4bc1-99c6-0964e3f024fc
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 14:56:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [req-7b3272ed-cc25-4d8c-96e6-39204e3d5dc0] Created resource provider record via placement API for resource provider with UUID de22140b-6a80-4bc1-99c6-0964e3f024fc and name user.
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73091) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 14:56:03 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] kernel doesn't support AMD SEV
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Libvirt baseline CPU <cpu>
Aug 16 14:56:03 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 14:56:03 user nova-compute[73091]:   <model>Nehalem</model>
Aug 16 14:56:03 user nova-compute[73091]:   <vendor>Intel</vendor>
Aug 16 14:56:03 user nova-compute[73091]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 14:56:03 user nova-compute[73091]: </cpu>
Aug 16 14:56:03 user nova-compute[73091]:  {{(pid=73091) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Updated inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Updating resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc generation from 0 to 1 during operation: update_inventory {{(pid=73091) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Updating resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc generation from 1 to 2 during operation: update_traits {{(pid=73091) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.service [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Creating RPC server for service compute {{(pid=73091) start /opt/stack/nova/nova/service.py:182}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.service [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Join ServiceGroup membership for this service compute {{(pid=73091) start /opt/stack/nova/nova/service.py:199}}
Aug 16 14:56:03 user nova-compute[73091]: DEBUG nova.servicegroup.drivers.db [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73091) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 14:56:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 14:56:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:56:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=26.287105560302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 14:56:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:57:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 14:57:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:57:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:57:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=10250MB free_disk=26.344406127929688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:57:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:57:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 14:58:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:58:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=10200MB free_disk=26.119709014892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 14:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:58:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:58:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 14:59:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 14:59:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:59:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=9543MB free_disk=26.14901351928711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 14:59:56 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 14:59:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "daf4f67c-fc4a-4386-8347-07c350412126" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:12 user nova-compute[73091]: INFO nova.compute.claims [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Claim successful on node user
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.160s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:12 user nova-compute[73091]: INFO nova.compute.claims [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Claim successful on node user
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Creating image(s)
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "/opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.policy [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0243ed66e484f6a820421b1f69ece02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4d07f3079144a59f93086e00017115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.policy [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9348c14ed1dc496ebf20d26e3b31779a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cabeffd95264d63aa6802f8a91387e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Creating image(s)
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.part --force-share --output=json" returned: 0 in 0.253s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.virt.images [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] b18d278d-2e25-4ef6-ba90-d1af21f699be was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.part /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:14 user nova-compute[73091]: INFO nova.compute.claims [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Claim successful on node user
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.part /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.converted" returned: 0 in 0.340s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.372s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:14 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpluxel7g0/privsep.sock']
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.727s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:14 user sudo[82379]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpluxel7g0/privsep.sock
Aug 16 15:00:14 user sudo[82379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.492s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:14 user nova-compute[73091]: INFO nova.compute.claims [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Claim successful on node user
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Creating image(s)
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "/opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "/opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.863s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:15 user nova-compute[73091]: INFO nova.compute.claims [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Claim successful on node user
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.policy [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1586b025ccec4a1a9d6912b596a1f432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a38cf70d24848258e7c2baa433b8dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Creating image(s)
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "/opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "/opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "/opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:15 user nova-compute[73091]: DEBUG nova.policy [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '058c604dd70b49f6b8fa356a81344415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6131b7ede5ec41eb9441f103318fe81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Creating image(s)
Aug 16 15:00:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:16 user nova-compute[73091]: DEBUG nova.policy [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9348c14ed1dc496ebf20d26e3b31779a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cabeffd95264d63aa6802f8a91387e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:16 user sudo[82379]: pam_unix(sudo:session): session closed for user root
Aug 16 15:00:16 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Spawned new privsep daemon via rootwrap
Aug 16 15:00:16 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 15:00:16 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 15:00:16 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 15:00:16 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82383
Aug 16 15:00:16 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] privsep daemon already running
Aug 16 15:00:16 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] privsep daemon already running
Aug 16 15:00:16 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] privsep daemon already running
Aug 16 15:00:16 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] privsep daemon already running
Aug 16 15:00:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Successfully created port: 0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.236s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.237s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk 1073741824" returned: 0 in 0.065s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.525s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Cannot resize image /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'migration_context' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Ensure instance console log exists: /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Successfully created port: ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk 1073741824" returned: 0 in 0.090s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Successfully created port: ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.791s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Cannot resize image /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'migration_context' on Instance uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Ensure instance console log exists: /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk 1073741824" returned: 0 in 0.048s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.062s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Cannot resize image /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'migration_context' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Ensure instance console log exists: /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Cannot resize image /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lazy-loading 'migration_context' on Instance uuid 4481eb2c-88c2-4ada-a08f-31a9c3d325cd {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk 1073741824" returned: 0 in 0.233s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.445s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Ensure instance console log exists: /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Successfully created port: 792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.157s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Cannot resize image /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lazy-loading 'migration_context' on Instance uuid e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Ensure instance console log exists: /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Successfully created port: 0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Successfully updated port: 0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-changed-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Refreshing instance network info cache due to event network-changed-0b71273e-c1f5-49dc-9eda-63f7d131828f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Successfully updated port: ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquired lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Successfully updated port: ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-changed-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Refreshing instance network info cache due to event network-changed-ca5b31b7-71d4-4945-9788-c04246e29539. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] Acquiring lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance network_info: |[{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Refreshing network info cache for port 0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Start _get_guest_xml network_info=[{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-13584052',display_name='tempest-ServerRescueNegativeTestJSON-server-13584052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-13584052',id=2,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-soyz7s4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:13Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=9498b706-c5d2-4ba8-9d94-bc335fbdca2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'pci_devices' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:22 user nova-compute[73091]:   <uuid>9498b706-c5d2-4ba8-9d94-bc335fbdca2b</uuid>
Aug 16 15:00:22 user nova-compute[73091]:   <name>instance-00000002</name>
Aug 16 15:00:22 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:22 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:22 user nova-compute[73091]:   <metadata>
Aug 16 15:00:22 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:22 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-13584052</nova:name>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:22</nova:creationTime>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:22 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:22 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:user uuid="9348c14ed1dc496ebf20d26e3b31779a">tempest-ServerRescueNegativeTestJSON-789793483-project-member</nova:user>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:project uuid="4cabeffd95264d63aa6802f8a91387e9">tempest-ServerRescueNegativeTestJSON-789793483</nova:project>
Aug 16 15:00:22 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:port uuid="0b71273e-c1f5-49dc-9eda-63f7d131828f">
Aug 16 15:00:22 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 15:00:22 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:22 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:22 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:22 user nova-compute[73091]:   </metadata>
Aug 16 15:00:22 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:22 user nova-compute[73091]:     <system>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="serial">9498b706-c5d2-4ba8-9d94-bc335fbdca2b</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="uuid">9498b706-c5d2-4ba8-9d94-bc335fbdca2b</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:22 user nova-compute[73091]:     </system>
Aug 16 15:00:22 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:22 user nova-compute[73091]:   <os>
Aug 16 15:00:22 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:22 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:22 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:22 user nova-compute[73091]:   </os>
Aug 16 15:00:22 user nova-compute[73091]:   <features>
Aug 16 15:00:22 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:22 user nova-compute[73091]:     <apic/>
Aug 16 15:00:22 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:22 user nova-compute[73091]:   </features>
Aug 16 15:00:22 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:22 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:22 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:22 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:22 user nova-compute[73091]:   </clock>
Aug 16 15:00:22 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:22 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:22 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:22 user nova-compute[73091]:   </cpu>
Aug 16 15:00:22 user nova-compute[73091]:   <devices>
Aug 16 15:00:22 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:22 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:22 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk"/>
Aug 16 15:00:22 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:22 user nova-compute[73091]:     </disk>
Aug 16 15:00:22 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:22 user nova-compute[73091]:       <mac address="fa:16:3e:da:30:1a"/>
Aug 16 15:00:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:22 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:22 user nova-compute[73091]:       <target dev="tap0b71273e-c1"/>
Aug 16 15:00:22 user nova-compute[73091]:     </interface>
Aug 16 15:00:22 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:22 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/console.log" append="off"/>
Aug 16 15:00:22 user nova-compute[73091]:     </serial>
Aug 16 15:00:22 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:22 user nova-compute[73091]:     <video>
Aug 16 15:00:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:22 user nova-compute[73091]:     </video>
Aug 16 15:00:22 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:22 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:22 user nova-compute[73091]:     </rng>
Aug 16 15:00:22 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:22 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:22 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:22 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:22 user nova-compute[73091]:   </devices>
Aug 16 15:00:22 user nova-compute[73091]: </domain>
Aug 16 15:00:22 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-13584052',display_name='tempest-ServerRescueNegativeTestJSON-server-13584052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-13584052',id=2,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-soyz7s4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:13Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=9498b706-c5d2-4ba8-9d94-bc335fbdca2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG os_vif [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Created schema index Interface.name {{(pid=73091) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Created schema index Port.name {{(pid=73091) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Created schema index Bridge.name {{(pid=73091) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [POLLOUT] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:22 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpx7bfym8c/privsep.sock']
Aug 16 15:00:22 user sudo[82469]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpx7bfym8c/privsep.sock
Aug 16 15:00:22 user sudo[82469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updating instance_info_cache with network_info: [{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Instance network_info: |[{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] Acquired lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Refreshing network info cache for port ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Start _get_guest_xml network_info=[{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2058445633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2058445633',id=1,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-v5tzy4zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:13Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=daf4f67c-fc4a-4386-8347-07c350412126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'pci_devices' on Instance uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:22 user nova-compute[73091]:   <uuid>daf4f67c-fc4a-4386-8347-07c350412126</uuid>
Aug 16 15:00:22 user nova-compute[73091]:   <name>instance-00000001</name>
Aug 16 15:00:22 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:22 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:22 user nova-compute[73091]:   <metadata>
Aug 16 15:00:22 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:22 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2058445633</nova:name>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:22</nova:creationTime>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:22 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:22 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:user uuid="c0243ed66e484f6a820421b1f69ece02">tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member</nova:user>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:project uuid="7c4d07f3079144a59f93086e00017115">tempest-ServerBootFromVolumeStableRescueTest-909556237</nova:project>
Aug 16 15:00:22 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:22 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:22 user nova-compute[73091]:         <nova:port uuid="ca5b31b7-71d4-4945-9788-c04246e29539">
Aug 16 15:00:22 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:00:22 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:22 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:22 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:22 user nova-compute[73091]:   </metadata>
Aug 16 15:00:22 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:22 user nova-compute[73091]:     <system>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="serial">daf4f67c-fc4a-4386-8347-07c350412126</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="uuid">daf4f67c-fc4a-4386-8347-07c350412126</entry>
Aug 16 15:00:22 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:22 user nova-compute[73091]:     </system>
Aug 16 15:00:22 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:22 user nova-compute[73091]:   <os>
Aug 16 15:00:22 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:22 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:22 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:22 user nova-compute[73091]:   </os>
Aug 16 15:00:22 user nova-compute[73091]:   <features>
Aug 16 15:00:22 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:22 user nova-compute[73091]:     <apic/>
Aug 16 15:00:22 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:22 user nova-compute[73091]:   </features>
Aug 16 15:00:22 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:22 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:22 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:22 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:22 user nova-compute[73091]:   </clock>
Aug 16 15:00:22 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:22 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:22 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:22 user nova-compute[73091]:   </cpu>
Aug 16 15:00:22 user nova-compute[73091]:   <devices>
Aug 16 15:00:22 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:22 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:22 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk"/>
Aug 16 15:00:22 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:22 user nova-compute[73091]:     </disk>
Aug 16 15:00:22 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:22 user nova-compute[73091]:       <mac address="fa:16:3e:ac:ae:14"/>
Aug 16 15:00:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:22 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:22 user nova-compute[73091]:       <target dev="tapca5b31b7-71"/>
Aug 16 15:00:22 user nova-compute[73091]:     </interface>
Aug 16 15:00:22 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:22 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/console.log" append="off"/>
Aug 16 15:00:22 user nova-compute[73091]:     </serial>
Aug 16 15:00:22 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:22 user nova-compute[73091]:     <video>
Aug 16 15:00:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:22 user nova-compute[73091]:     </video>
Aug 16 15:00:22 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:22 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:22 user nova-compute[73091]:     </rng>
Aug 16 15:00:22 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:22 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:22 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:22 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:22 user nova-compute[73091]:   </devices>
Aug 16 15:00:22 user nova-compute[73091]: </domain>
Aug 16 15:00:22 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2058445633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2058445633',id=1,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-v5tzy4zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:13Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=daf4f67c-fc4a-4386-8347-07c350412126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG os_vif [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Successfully updated port: 792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "refresh_cache-e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquired lock "refresh_cache-e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Updating instance_info_cache with network_info: [{"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-changed-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Refreshing instance network info cache due to event network-changed-ab6af4f3-d9c3-404b-8496-8db3fe081883. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] Acquiring lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Releasing lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Instance network_info: |[{"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] Acquired lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Refreshing network info cache for port ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Start _get_guest_xml network_info=[{"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-927453113',display_name='tempest-ServersNegativeTestJSON-server-927453113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-927453113',id=3,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6131b7ede5ec41eb9441f103318fe81f',ramdisk_id='',reservation_id='r-saq7dyz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-290315528',owner_user_name='tempest-ServersNegativeTestJSON-290315528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:16Z,user_data=None,user_id='058c604dd70b49f6b8fa356a81344415',uuid=4481eb2c-88c2-4ada-a08f-31a9c3d325cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converting VIF {"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lazy-loading 'pci_devices' on Instance uuid 4481eb2c-88c2-4ada-a08f-31a9c3d325cd {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:23 user nova-compute[73091]:   <uuid>4481eb2c-88c2-4ada-a08f-31a9c3d325cd</uuid>
Aug 16 15:00:23 user nova-compute[73091]:   <name>instance-00000003</name>
Aug 16 15:00:23 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:23 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:23 user nova-compute[73091]:   <metadata>
Aug 16 15:00:23 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:23 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:23 user nova-compute[73091]:       <nova:name>tempest-ServersNegativeTestJSON-server-927453113</nova:name>
Aug 16 15:00:23 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:23</nova:creationTime>
Aug 16 15:00:23 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:23 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:23 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:23 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:user uuid="058c604dd70b49f6b8fa356a81344415">tempest-ServersNegativeTestJSON-290315528-project-member</nova:user>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:project uuid="6131b7ede5ec41eb9441f103318fe81f">tempest-ServersNegativeTestJSON-290315528</nova:project>
Aug 16 15:00:23 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:23 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:23 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:23 user nova-compute[73091]:         <nova:port uuid="ab6af4f3-d9c3-404b-8496-8db3fe081883">
Aug 16 15:00:23 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:00:23 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:23 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:23 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:23 user nova-compute[73091]:   </metadata>
Aug 16 15:00:23 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:23 user nova-compute[73091]:     <system>
Aug 16 15:00:23 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:23 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:23 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:23 user nova-compute[73091]:       <entry name="serial">4481eb2c-88c2-4ada-a08f-31a9c3d325cd</entry>
Aug 16 15:00:23 user nova-compute[73091]:       <entry name="uuid">4481eb2c-88c2-4ada-a08f-31a9c3d325cd</entry>
Aug 16 15:00:23 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:23 user nova-compute[73091]:     </system>
Aug 16 15:00:23 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:23 user nova-compute[73091]:   <os>
Aug 16 15:00:23 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:23 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:23 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:23 user nova-compute[73091]:   </os>
Aug 16 15:00:23 user nova-compute[73091]:   <features>
Aug 16 15:00:23 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:23 user nova-compute[73091]:     <apic/>
Aug 16 15:00:23 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:23 user nova-compute[73091]:   </features>
Aug 16 15:00:23 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:23 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:23 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:23 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:23 user nova-compute[73091]:   </clock>
Aug 16 15:00:23 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:23 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:23 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:23 user nova-compute[73091]:   </cpu>
Aug 16 15:00:23 user nova-compute[73091]:   <devices>
Aug 16 15:00:23 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:23 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:23 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk"/>
Aug 16 15:00:23 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:23 user nova-compute[73091]:     </disk>
Aug 16 15:00:23 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:23 user nova-compute[73091]:       <mac address="fa:16:3e:ab:d6:82"/>
Aug 16 15:00:23 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:23 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:23 user nova-compute[73091]:       <target dev="tapab6af4f3-d9"/>
Aug 16 15:00:23 user nova-compute[73091]:     </interface>
Aug 16 15:00:23 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:23 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/console.log" append="off"/>
Aug 16 15:00:23 user nova-compute[73091]:     </serial>
Aug 16 15:00:23 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:23 user nova-compute[73091]:     <video>
Aug 16 15:00:23 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:23 user nova-compute[73091]:     </video>
Aug 16 15:00:23 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:23 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:23 user nova-compute[73091]:     </rng>
Aug 16 15:00:23 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:23 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:23 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:23 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:23 user nova-compute[73091]:   </devices>
Aug 16 15:00:23 user nova-compute[73091]: </domain>
Aug 16 15:00:23 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-927453113',display_name='tempest-ServersNegativeTestJSON-server-927453113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-927453113',id=3,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6131b7ede5ec41eb9441f103318fe81f',ramdisk_id='',reservation_id='r-saq7dyz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-290315528',owner_user_name='tempest-ServersNegativeTestJSON-290315528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:16Z,user_data=None,user_id='058c604dd70b49f6b8fa356a81344415',uuid=4481eb2c-88c2-4ada-a08f-31a9c3d325cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converting VIF {"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG os_vif [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:23 user nova-compute[73091]: INFO nova.compute.claims [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Claim successful on node user
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Successfully updated port: 0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updated VIF entry in instance network info cache for port 0b71273e-c1f5-49dc-9eda-63f7d131828f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d9d65a87-5737-4b69-ba63-c0d295d40f93 req-8ddb63e8-bf10-490e-af48-d2cc87852895 service nova] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updated VIF entry in instance network info cache for port ca5b31b7-71d4-4945-9788-c04246e29539. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updating instance_info_cache with network_info: [{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-665756ef-9833-4770-981c-495ff45009f0 req-27ced045-857e-46c9-a062-4a5e96b41225 service nova] Releasing lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-changed-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Refreshing instance network info cache due to event network-changed-792889e7-92aa-4b94-90a9-1927fa731c2a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] Acquiring lock "refresh_cache-e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-changed-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Refreshing instance network info cache due to event network-changed-0033d35a-c433-418f-8abf-383712f7aa19. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] Acquiring lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:24 user sudo[82469]: pam_unix(sudo:session): session closed for user root
Aug 16 15:00:24 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Spawned new privsep daemon via rootwrap
Aug 16 15:00:24 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 15:00:24 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 15:00:24 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 15:00:24 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82476
Aug 16 15:00:24 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] privsep daemon already running
Aug 16 15:00:24 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] privsep daemon already running
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Creating image(s)
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "/opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "/opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.policy [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40bf98e80707482a9c43719d7a56004a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af3ee8a3c64c50a44aa98bcdd05222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.167s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Updating instance_info_cache with network_info: [{"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b71273e-c1, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b71273e-c1, col_values=(('external_ids', {'iface-id': '0b71273e-c1f5-49dc-9eda-63f7d131828f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:30:1a', 'vm-uuid': '9498b706-c5d2-4ba8-9d94-bc335fbdca2b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk 1073741824" returned: 0 in 0.096s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Releasing lock "refresh_cache-e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Instance network_info: |[{"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] Acquired lock "refresh_cache-e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Refreshing network info cache for port 792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Start _get_guest_xml network_info=[{"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca5b31b7-71, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca5b31b7-71, col_values=(('external_ids', {'iface-id': 'ca5b31b7-71d4-4945-9788-c04246e29539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:ae:14', 'vm-uuid': 'daf4f67c-fc4a-4386-8347-07c350412126'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: INFO os_vif [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1')
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: INFO os_vif [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71')
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab6af4f3-d9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab6af4f3-d9, col_values=(('external_ids', {'iface-id': 'ab6af4f3-d9c3-404b-8496-8db3fe081883', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:d6:82', 'vm-uuid': '4481eb2c-88c2-4ada-a08f-31a9c3d325cd'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-319316043',display_name='tempest-DeleteServersTestJSON-server-319316043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-319316043',id=4,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a38cf70d24848258e7c2baa433b8dc8',ramdisk_id='',reservation_id='r-115eb66t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-592121302',owner_user_name='tempest-DeleteServersTestJSON-592121302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:15Z,user_data=None,user_id='1586b025ccec4a1a9d6912b596a1f432',uuid=e7892ea7-3d6a-4172-bc89-26fd00b7f3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Converting VIF {"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lazy-loading 'pci_devices' on Instance uuid e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Updated VIF entry in instance network info cache for port ab6af4f3-d9c3-404b-8496-8db3fe081883. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Updating instance_info_cache with network_info: [{"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: INFO os_vif [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9')
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:25 user nova-compute[73091]:   <uuid>e7892ea7-3d6a-4172-bc89-26fd00b7f3d2</uuid>
Aug 16 15:00:25 user nova-compute[73091]:   <name>instance-00000004</name>
Aug 16 15:00:25 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:25 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:25 user nova-compute[73091]:   <metadata>
Aug 16 15:00:25 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:25 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:name>tempest-DeleteServersTestJSON-server-319316043</nova:name>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:25</nova:creationTime>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:25 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:25 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:user uuid="1586b025ccec4a1a9d6912b596a1f432">tempest-DeleteServersTestJSON-592121302-project-member</nova:user>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:project uuid="6a38cf70d24848258e7c2baa433b8dc8">tempest-DeleteServersTestJSON-592121302</nova:project>
Aug 16 15:00:25 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:port uuid="792889e7-92aa-4b94-90a9-1927fa731c2a">
Aug 16 15:00:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:00:25 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:25 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:25 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:25 user nova-compute[73091]:   </metadata>
Aug 16 15:00:25 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:25 user nova-compute[73091]:     <system>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="serial">e7892ea7-3d6a-4172-bc89-26fd00b7f3d2</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="uuid">e7892ea7-3d6a-4172-bc89-26fd00b7f3d2</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:25 user nova-compute[73091]:     </system>
Aug 16 15:00:25 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:25 user nova-compute[73091]:   <os>
Aug 16 15:00:25 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:25 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:25 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:25 user nova-compute[73091]:   </os>
Aug 16 15:00:25 user nova-compute[73091]:   <features>
Aug 16 15:00:25 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:25 user nova-compute[73091]:     <apic/>
Aug 16 15:00:25 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:25 user nova-compute[73091]:   </features>
Aug 16 15:00:25 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:25 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:25 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:25 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:25 user nova-compute[73091]:   </clock>
Aug 16 15:00:25 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:25 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:25 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:25 user nova-compute[73091]:   </cpu>
Aug 16 15:00:25 user nova-compute[73091]:   <devices>
Aug 16 15:00:25 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:25 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:25 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk"/>
Aug 16 15:00:25 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:25 user nova-compute[73091]:     </disk>
Aug 16 15:00:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:25 user nova-compute[73091]:       <mac address="fa:16:3e:52:0b:bf"/>
Aug 16 15:00:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:25 user nova-compute[73091]:       <target dev="tap792889e7-92"/>
Aug 16 15:00:25 user nova-compute[73091]:     </interface>
Aug 16 15:00:25 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:25 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/console.log" append="off"/>
Aug 16 15:00:25 user nova-compute[73091]:     </serial>
Aug 16 15:00:25 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:25 user nova-compute[73091]:     <video>
Aug 16 15:00:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:25 user nova-compute[73091]:     </video>
Aug 16 15:00:25 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:25 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:25 user nova-compute[73091]:     </rng>
Aug 16 15:00:25 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:25 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:25 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:25 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:25 user nova-compute[73091]:   </devices>
Aug 16 15:00:25 user nova-compute[73091]: </domain>
Aug 16 15:00:25 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-319316043',display_name='tempest-DeleteServersTestJSON-server-319316043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-319316043',id=4,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a38cf70d24848258e7c2baa433b8dc8',ramdisk_id='',reservation_id='r-115eb66t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-592121302',owner_user_name='tempest-DeleteServersTestJSON-592121302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:15Z,user_data=None,user_id='1586b025ccec4a1a9d6912b596a1f432',uuid=e7892ea7-3d6a-4172-bc89-26fd00b7f3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Converting VIF {"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG os_vif [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d691767-e72f-43e1-984d-9b19578191e5 req-9cee8be9-6ca8-4053-af2f-1a5f38e033dd service nova] Releasing lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap792889e7-92, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap792889e7-92, col_values=(('external_ids', {'iface-id': '792889e7-92aa-4b94-90a9-1927fa731c2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:0b:bf', 'vm-uuid': 'e7892ea7-3d6a-4172-bc89-26fd00b7f3d2'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: INFO os_vif [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92')
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance network_info: |[{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] Acquired lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Refreshing network info cache for port 0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Start _get_guest_xml network_info=[{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] No VIF found with MAC fa:16:3e:ab:d6:82, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:da:30:1a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No VIF found with MAC fa:16:3e:ac:ae:14, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] No VIF found with MAC fa:16:3e:52:0b:bf, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056364814',display_name='tempest-ServerRescueNegativeTestJSON-server-2056364814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056364814',id=5,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-tz06aexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:16Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=90c2173a-a2c8-4162-8d81-640cc85ee05a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'pci_devices' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Cannot resize image /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'migration_context' on Instance uuid b6791c34-3d16-4317-b1ca-f698edda9780 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:25 user nova-compute[73091]:   <uuid>90c2173a-a2c8-4162-8d81-640cc85ee05a</uuid>
Aug 16 15:00:25 user nova-compute[73091]:   <name>instance-00000005</name>
Aug 16 15:00:25 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:25 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:25 user nova-compute[73091]:   <metadata>
Aug 16 15:00:25 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:25 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2056364814</nova:name>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:25</nova:creationTime>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:25 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:25 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:user uuid="9348c14ed1dc496ebf20d26e3b31779a">tempest-ServerRescueNegativeTestJSON-789793483-project-member</nova:user>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:project uuid="4cabeffd95264d63aa6802f8a91387e9">tempest-ServerRescueNegativeTestJSON-789793483</nova:project>
Aug 16 15:00:25 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:25 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:25 user nova-compute[73091]:         <nova:port uuid="0033d35a-c433-418f-8abf-383712f7aa19">
Aug 16 15:00:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:00:25 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:25 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:25 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:25 user nova-compute[73091]:   </metadata>
Aug 16 15:00:25 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:25 user nova-compute[73091]:     <system>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="serial">90c2173a-a2c8-4162-8d81-640cc85ee05a</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="uuid">90c2173a-a2c8-4162-8d81-640cc85ee05a</entry>
Aug 16 15:00:25 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:25 user nova-compute[73091]:     </system>
Aug 16 15:00:25 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:25 user nova-compute[73091]:   <os>
Aug 16 15:00:25 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:25 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:25 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:25 user nova-compute[73091]:   </os>
Aug 16 15:00:25 user nova-compute[73091]:   <features>
Aug 16 15:00:25 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:25 user nova-compute[73091]:     <apic/>
Aug 16 15:00:25 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:25 user nova-compute[73091]:   </features>
Aug 16 15:00:25 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:25 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:25 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:25 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:25 user nova-compute[73091]:   </clock>
Aug 16 15:00:25 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:25 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:25 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:25 user nova-compute[73091]:   </cpu>
Aug 16 15:00:25 user nova-compute[73091]:   <devices>
Aug 16 15:00:25 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:25 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:25 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk"/>
Aug 16 15:00:25 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:25 user nova-compute[73091]:     </disk>
Aug 16 15:00:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:25 user nova-compute[73091]:       <mac address="fa:16:3e:01:a6:0b"/>
Aug 16 15:00:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:25 user nova-compute[73091]:       <target dev="tap0033d35a-c4"/>
Aug 16 15:00:25 user nova-compute[73091]:     </interface>
Aug 16 15:00:25 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:25 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/console.log" append="off"/>
Aug 16 15:00:25 user nova-compute[73091]:     </serial>
Aug 16 15:00:25 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:25 user nova-compute[73091]:     <video>
Aug 16 15:00:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:25 user nova-compute[73091]:     </video>
Aug 16 15:00:25 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:25 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:25 user nova-compute[73091]:     </rng>
Aug 16 15:00:25 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:25 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:25 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:25 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:25 user nova-compute[73091]:   </devices>
Aug 16 15:00:25 user nova-compute[73091]: </domain>
Aug 16 15:00:25 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056364814',display_name='tempest-ServerRescueNegativeTestJSON-server-2056364814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056364814',id=5,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-tz06aexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:16Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=90c2173a-a2c8-4162-8d81-640cc85ee05a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG os_vif [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0033d35a-c4, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0033d35a-c4, col_values=(('external_ids', {'iface-id': '0033d35a-c433-418f-8abf-383712f7aa19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:a6:0b', 'vm-uuid': '90c2173a-a2c8-4162-8d81-640cc85ee05a'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Ensure instance console log exists: /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:25 user nova-compute[73091]: INFO os_vif [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4')
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:01:a6:0b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updated VIF entry in instance network info cache for port 0033d35a-c433-418f-8abf-383712f7aa19. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-449bc9e8-8aa3-4af9-a246-b8972812f882 req-d0aba4a7-1338-485c-a9d9-8ab10cd74f05 service nova] Releasing lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Successfully created port: b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Updated VIF entry in instance network info cache for port 792889e7-92aa-4b94-90a9-1927fa731c2a. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Updating instance_info_cache with network_info: [{"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1925d6b3-6413-436a-ae3f-f95e351f1279 req-21ac85ce-b19c-459b-ac9d-a94faf14bde9 service nova] Releasing lock "refresh_cache-e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Successfully updated port: b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-changed-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Refreshing instance network info cache due to event network-changed-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Instance network_info: |[{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Refreshing network info cache for port b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Start _get_guest_xml network_info=[{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updated VIF entry in instance network info cache for port b2c5eaab-2de0-4764-9f7e-befb33ef9e7c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfef977a-a374-41ae-90c1-e41954c7112a req-b49a8adb-1e5a-4466-bf5e-2bb94e672e9d service nova] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.7496252, e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] VM Resumed (Lifecycle Event)
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Instance spawned successfully.
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance spawned successfully.
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1488066308',display_name='tempest-ServerActionsTestOtherA-server-1488066308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1488066308',id=6,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-zjc71q53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=b6791c34-3d16-4317-b1ca-f698edda9780,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_devices' on Instance uuid b6791c34-3d16-4317-b1ca-f698edda9780 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.753359, e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] VM Started (Lifecycle Event)
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Instance spawned successfully.
Aug 16 15:00:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Instance spawned successfully.
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Took 19.76 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.7678113, 90c2173a-a2c8-4162-8d81-640cc85ee05a => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] VM Resumed (Lifecycle Event)
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Took 18.59 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:35 user nova-compute[73091]:   <uuid>b6791c34-3d16-4317-b1ca-f698edda9780</uuid>
Aug 16 15:00:35 user nova-compute[73091]:   <name>instance-00000006</name>
Aug 16 15:00:35 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:35 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:35 user nova-compute[73091]:   <metadata>
Aug 16 15:00:35 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:35 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:35 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-1488066308</nova:name>
Aug 16 15:00:35 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:34</nova:creationTime>
Aug 16 15:00:35 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:35 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:35 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:35 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:user uuid="40bf98e80707482a9c43719d7a56004a">tempest-ServerActionsTestOtherA-305054434-project-member</nova:user>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:project uuid="99af3ee8a3c64c50a44aa98bcdd05222">tempest-ServerActionsTestOtherA-305054434</nova:project>
Aug 16 15:00:35 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:35 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:35 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:35 user nova-compute[73091]:         <nova:port uuid="b2c5eaab-2de0-4764-9f7e-befb33ef9e7c">
Aug 16 15:00:35 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:00:35 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:35 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:35 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:35 user nova-compute[73091]:   </metadata>
Aug 16 15:00:35 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:35 user nova-compute[73091]:     <system>
Aug 16 15:00:35 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:35 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:35 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:35 user nova-compute[73091]:       <entry name="serial">b6791c34-3d16-4317-b1ca-f698edda9780</entry>
Aug 16 15:00:35 user nova-compute[73091]:       <entry name="uuid">b6791c34-3d16-4317-b1ca-f698edda9780</entry>
Aug 16 15:00:35 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:35 user nova-compute[73091]:     </system>
Aug 16 15:00:35 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:35 user nova-compute[73091]:   <os>
Aug 16 15:00:35 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:35 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:35 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:35 user nova-compute[73091]:   </os>
Aug 16 15:00:35 user nova-compute[73091]:   <features>
Aug 16 15:00:35 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:35 user nova-compute[73091]:     <apic/>
Aug 16 15:00:35 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:35 user nova-compute[73091]:   </features>
Aug 16 15:00:35 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:35 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:35 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:35 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:35 user nova-compute[73091]:   </clock>
Aug 16 15:00:35 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:35 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:35 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:35 user nova-compute[73091]:   </cpu>
Aug 16 15:00:35 user nova-compute[73091]:   <devices>
Aug 16 15:00:35 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:35 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:35 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk"/>
Aug 16 15:00:35 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:35 user nova-compute[73091]:     </disk>
Aug 16 15:00:35 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:35 user nova-compute[73091]:       <mac address="fa:16:3e:89:5b:a6"/>
Aug 16 15:00:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:35 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:35 user nova-compute[73091]:       <target dev="tapb2c5eaab-2d"/>
Aug 16 15:00:35 user nova-compute[73091]:     </interface>
Aug 16 15:00:35 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:35 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/console.log" append="off"/>
Aug 16 15:00:35 user nova-compute[73091]:     </serial>
Aug 16 15:00:35 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:35 user nova-compute[73091]:     <video>
Aug 16 15:00:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:35 user nova-compute[73091]:     </video>
Aug 16 15:00:35 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:35 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:35 user nova-compute[73091]:     </rng>
Aug 16 15:00:35 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:35 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:35 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:35 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:35 user nova-compute[73091]:   </devices>
Aug 16 15:00:35 user nova-compute[73091]: </domain>
Aug 16 15:00:35 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1488066308',display_name='tempest-ServerActionsTestOtherA-server-1488066308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1488066308',id=6,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-zjc71q53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=b6791c34-3d16-4317-b1ca-f698edda9780,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG os_vif [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2c5eaab-2d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2c5eaab-2d, col_values=(('external_ids', {'iface-id': 'b2c5eaab-2de0-4764-9f7e-befb33ef9e7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:5b:a6', 'vm-uuid': 'b6791c34-3d16-4317-b1ca-f698edda9780'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:35 user nova-compute[73091]: INFO os_vif [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d')
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Took 19.35 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance spawned successfully.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Took 20.99 seconds to build instance.
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Took 21.90 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Took 20.73 seconds to build instance.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.7758873, 90c2173a-a2c8-4162-8d81-640cc85ee05a => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] VM Started (Lifecycle Event)
Aug 16 15:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a67015c3-55a9-4717-9f36-b6741ee05f03 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.265s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No VIF found with MAC fa:16:3e:89:5b:a6, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7737078e-1918-4780-b222-fa284ccda02f tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.046s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Took 21.15 seconds to build instance.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.8793764, 4481eb2c-88c2-4ada-a08f-31a9c3d325cd => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] VM Resumed (Lifecycle Event)
Aug 16 15:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d3fb9dd3-ef54-4b63-98d9-a6f5884f2855 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.504s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Took 23.33 seconds to build instance.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.8818865, 4481eb2c-88c2-4ada-a08f-31a9c3d325cd => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] VM Started (Lifecycle Event)
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Took 21.81 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8607642-f054-4491-9f42-e391d6ac058c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "daf4f67c-fc4a-4386-8347-07c350412126" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.598s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.9101927, daf4f67c-fc4a-4386-8347-07c350412126 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] VM Resumed (Lifecycle Event)
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198034.911204, daf4f67c-fc4a-4386-8347-07c350412126 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:36 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] VM Started (Lifecycle Event)
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:36 user nova-compute[73091]: INFO nova.compute.manager [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Took 23.74 seconds to build instance.
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198035.1444528, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:36 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Resumed (Lifecycle Event)
Aug 16 15:00:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd702751-2b7e-465a-976a-a6f44d8208f6 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.007s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198035.145671, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:36 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Started (Lifecycle Event)
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:37 user nova-compute[73091]: INFO nova.compute.claims [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Claim successful on node user
Aug 16 15:00:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.132s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG nova.policy [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d70a163fb8748bd93a6d0dd391325ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3614b459a8405da3c723520c7ed2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Creating image(s)
Aug 16 15:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "/opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "/opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "4acdf1b2f7d5e8db5670a1db81da0228f242c160" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "4acdf1b2f7d5e8db5670a1db81da0228f242c160" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-92606e87-561f-444c-a48f-0ed8fba80bc8 req-d4a276ff-cf91-4663-80ce-b2c4ae195d98 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-92606e87-561f-444c-a48f-0ed8fba80bc8 req-d4a276ff-cf91-4663-80ce-b2c4ae195d98 service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-92606e87-561f-444c-a48f-0ed8fba80bc8 req-d4a276ff-cf91-4663-80ce-b2c4ae195d98 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-92606e87-561f-444c-a48f-0ed8fba80bc8 req-d4a276ff-cf91-4663-80ce-b2c4ae195d98 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-92606e87-561f-444c-a48f-0ed8fba80bc8 req-d4a276ff-cf91-4663-80ce-b2c4ae195d98 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:40 user nova-compute[73091]: WARNING nova.compute.manager [req-92606e87-561f-444c-a48f-0ed8fba80bc8 req-d4a276ff-cf91-4663-80ce-b2c4ae195d98 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state active and task_state None.
Aug 16 15:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.part --force-share --output=json" returned: 0 in 0.306s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG nova.virt.images [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] 6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.part /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.part /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.converted" returned: 0 in 0.611s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198041.881987, b6791c34-3d16-4317-b1ca-f698edda9780 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:41 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] VM Resumed (Lifecycle Event)
Aug 16 15:00:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Instance spawned successfully.
Aug 16 15:00:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160.converted --force-share --output=json" returned: 0 in 0.440s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "4acdf1b2f7d5e8db5670a1db81da0228f242c160" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.545s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198041.8965292, b6791c34-3d16-4317-b1ca-f698edda9780 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] VM Started (Lifecycle Event)
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Successfully created port: e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:42 user nova-compute[73091]: WARNING nova.compute.manager [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state active and task_state None.
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:42 user nova-compute[73091]: WARNING nova.compute.manager [req-4252d89d-caf4-4080-ad97-e874370654ac req-faf9728c-d464-41da-8515-756c5b63f099 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state None.
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:42 user nova-compute[73091]: INFO nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Took 17.81 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:42 user nova-compute[73091]: INFO nova.compute.manager [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Took 18.63 seconds to build instance.
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e75cd4f-ef4f-4fc9-b421-9f674dc85c8c tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.774s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 --force-share --output=json" returned: 0 in 0.630s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "4acdf1b2f7d5e8db5670a1db81da0228f242c160" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "4acdf1b2f7d5e8db5670a1db81da0228f242c160" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 --force-share --output=json" returned: 0 in 0.404s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160,backing_fmt=raw /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160,backing_fmt=raw /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk 1073741824" returned: 0 in 0.135s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "4acdf1b2f7d5e8db5670a1db81da0228f242c160" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.547s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 --force-share --output=json" returned: 0 in 0.360s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Cannot resize image /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lazy-loading 'migration_context' on Instance uuid c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Ensure instance console log exists: /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-fafa378d-ae95-4a0a-be96-321a91a2bab9 req-ebcf7efb-2811-42b7-bf1d-848c52e23dde service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fafa378d-ae95-4a0a-be96-321a91a2bab9 req-ebcf7efb-2811-42b7-bf1d-848c52e23dde service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fafa378d-ae95-4a0a-be96-321a91a2bab9 req-ebcf7efb-2811-42b7-bf1d-848c52e23dde service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fafa378d-ae95-4a0a-be96-321a91a2bab9 req-ebcf7efb-2811-42b7-bf1d-848c52e23dde service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-fafa378d-ae95-4a0a-be96-321a91a2bab9 req-ebcf7efb-2811-42b7-bf1d-848c52e23dde service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:44 user nova-compute[73091]: WARNING nova.compute.manager [req-fafa378d-ae95-4a0a-be96-321a91a2bab9 req-ebcf7efb-2811-42b7-bf1d-848c52e23dde service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state None.
Aug 16 15:00:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:46 user nova-compute[73091]: INFO nova.compute.claims [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Claim successful on node user
Aug 16 15:00:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Successfully updated port: e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquired lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-changed-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Refreshing instance network info cache due to event network-changed-e87df0c7-59e8-41ec-a8dc-93023a482c94. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] Acquiring lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.094s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updating instance_info_cache with network_info: [{"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Releasing lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Instance network_info: |[{"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] Acquired lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.neutron [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Refreshing network info cache for port e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Start _get_guest_xml network_info=[{"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T15:00:29Z,direct_url=<?>,disk_format='qcow2',id=6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a,min_disk=0,min_ram=0,name='',owner='93732df7a04d418d8fb01350323432ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T15:00:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T15:00:29Z,direct_url=<?>,disk_format='qcow2',id=6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a,min_disk=0,min_ram=0,name='',owner='93732df7a04d418d8fb01350323432ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T15:00:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1570765714',display_name='tempest-AttachSCSIVolumeTestJSON-server-1570765714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1570765714',id=7,image_ref='6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAklIKjapHEK7XkTlk4Y0xsDUqtKTt5ZM1cxln/eiHdtrAO1WWMWVMjVTbAxJfda3M3EKAtyJj+CW3algTFo8lm8q57OpXz5fUGcw9dUmeiNVPOVVFTvlIyZplomLxa9MA==',key_name='tempest-keypair-371430310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3614b459a8405da3c723520c7ed2a2',ramdisk_id='',reservation_id='r-v9cmhvat',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-680640030',owner_user_name='tempest-AttachSCSIVolumeTestJSON-680640030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d70a163fb8748bd93a6d0dd391325ed',uuid=c1efefe8-9e86-4194-8c94-6eaafd4c22f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Converting VIF {"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lazy-loading 'pci_devices' on Instance uuid c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.policy [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9782834fd235447083d0580b13d518d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944792b19ee14226b529478fbfd50dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:47 user nova-compute[73091]:   <uuid>c1efefe8-9e86-4194-8c94-6eaafd4c22f7</uuid>
Aug 16 15:00:47 user nova-compute[73091]:   <name>instance-00000007</name>
Aug 16 15:00:47 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:47 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:47 user nova-compute[73091]:   <metadata>
Aug 16 15:00:47 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:47 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:47 user nova-compute[73091]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1570765714</nova:name>
Aug 16 15:00:47 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:47</nova:creationTime>
Aug 16 15:00:47 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:47 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:47 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:47 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:user uuid="6d70a163fb8748bd93a6d0dd391325ed">tempest-AttachSCSIVolumeTestJSON-680640030-project-member</nova:user>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:project uuid="4c3614b459a8405da3c723520c7ed2a2">tempest-AttachSCSIVolumeTestJSON-680640030</nova:project>
Aug 16 15:00:47 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:47 user nova-compute[73091]:       <nova:root type="image" uuid="6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a"/>
Aug 16 15:00:47 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:47 user nova-compute[73091]:         <nova:port uuid="e87df0c7-59e8-41ec-a8dc-93023a482c94">
Aug 16 15:00:47 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:00:47 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:47 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:47 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:47 user nova-compute[73091]:   </metadata>
Aug 16 15:00:47 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:47 user nova-compute[73091]:     <system>
Aug 16 15:00:47 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:47 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:47 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:47 user nova-compute[73091]:       <entry name="serial">c1efefe8-9e86-4194-8c94-6eaafd4c22f7</entry>
Aug 16 15:00:47 user nova-compute[73091]:       <entry name="uuid">c1efefe8-9e86-4194-8c94-6eaafd4c22f7</entry>
Aug 16 15:00:47 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:47 user nova-compute[73091]:     </system>
Aug 16 15:00:47 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:47 user nova-compute[73091]:   <os>
Aug 16 15:00:47 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:47 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:47 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:47 user nova-compute[73091]:   </os>
Aug 16 15:00:47 user nova-compute[73091]:   <features>
Aug 16 15:00:47 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:47 user nova-compute[73091]:     <apic/>
Aug 16 15:00:47 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:47 user nova-compute[73091]:   </features>
Aug 16 15:00:47 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:47 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:47 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:47 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:47 user nova-compute[73091]:   </clock>
Aug 16 15:00:47 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:47 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:47 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:47 user nova-compute[73091]:   </cpu>
Aug 16 15:00:47 user nova-compute[73091]:   <devices>
Aug 16 15:00:47 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:47 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:47 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk"/>
Aug 16 15:00:47 user nova-compute[73091]:       <target dev="sda" bus="scsi"/>
Aug 16 15:00:47 user nova-compute[73091]:       <address type="drive" controller="0" unit="0"/>
Aug 16 15:00:47 user nova-compute[73091]:     </disk>
Aug 16 15:00:47 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 15:00:47 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 15:00:47 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.config"/>
Aug 16 15:00:47 user nova-compute[73091]:       <target dev="sdb" bus="scsi"/>
Aug 16 15:00:47 user nova-compute[73091]:       <address type="drive" controller="0" unit="1"/>
Aug 16 15:00:47 user nova-compute[73091]:     </disk>
Aug 16 15:00:47 user nova-compute[73091]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 15:00:47 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:47 user nova-compute[73091]:       <mac address="fa:16:3e:a2:99:e8"/>
Aug 16 15:00:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:47 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:47 user nova-compute[73091]:       <target dev="tape87df0c7-59"/>
Aug 16 15:00:47 user nova-compute[73091]:     </interface>
Aug 16 15:00:47 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:47 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/console.log" append="off"/>
Aug 16 15:00:47 user nova-compute[73091]:     </serial>
Aug 16 15:00:47 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:47 user nova-compute[73091]:     <video>
Aug 16 15:00:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:47 user nova-compute[73091]:     </video>
Aug 16 15:00:47 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:47 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:47 user nova-compute[73091]:     </rng>
Aug 16 15:00:47 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:47 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:47 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:47 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:47 user nova-compute[73091]:   </devices>
Aug 16 15:00:47 user nova-compute[73091]: </domain>
Aug 16 15:00:47 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1570765714',display_name='tempest-AttachSCSIVolumeTestJSON-server-1570765714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1570765714',id=7,image_ref='6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAklIKjapHEK7XkTlk4Y0xsDUqtKTt5ZM1cxln/eiHdtrAO1WWMWVMjVTbAxJfda3M3EKAtyJj+CW3algTFo8lm8q57OpXz5fUGcw9dUmeiNVPOVVFTvlIyZplomLxa9MA==',key_name='tempest-keypair-371430310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3614b459a8405da3c723520c7ed2a2',ramdisk_id='',reservation_id='r-v9cmhvat',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-680640030',owner_user_name='tempest-AttachSCSIVolumeTestJSON-680640030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d70a163fb8748bd93a6d0dd391325ed',uuid=c1efefe8-9e86-4194-8c94-6eaafd4c22f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Converting VIF {"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG os_vif [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape87df0c7-59, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape87df0c7-59, col_values=(('external_ids', {'iface-id': 'e87df0c7-59e8-41ec-a8dc-93023a482c94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:99:e8', 'vm-uuid': 'c1efefe8-9e86-4194-8c94-6eaafd4c22f7'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:47 user nova-compute[73091]: INFO os_vif [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59')
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Creating image(s)
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "/opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "/opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No BDM found with device name sda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No VIF found with MAC fa:16:3e:a2:99:e8, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Using config drive
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.263s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.011s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.248s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk 1073741824" returned: 0 in 0.120s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Creating config drive at /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.config
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmmmyxoxo {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Successfully created port: 655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmmmyxoxo" returned: 0 in 0.078s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.593s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Cannot resize image /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'migration_context' on Instance uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Ensure instance console log exists: /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updated VIF entry in instance network info cache for port e87df0c7-59e8-41ec-a8dc-93023a482c94. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updating instance_info_cache with network_info: [{"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e187aa8f-f726-4ff4-ba30-0fe51fd3485c req-73d80ec0-d81b-48ea-ba2a-3aa5e7d9b06f service nova] Releasing lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:50 user nova-compute[73091]: INFO nova.compute.claims [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Claim successful on node user
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Successfully updated port: 655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquired lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received event network-changed-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Refreshing instance network info cache due to event network-changed-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] Acquiring lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.913s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-7bd9a2f5-f64d-46ec-9387-4f03be6e5ff6 req-3e30f0db-b3af-43cf-a9e2-f74202322a85 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7bd9a2f5-f64d-46ec-9387-4f03be6e5ff6 req-3e30f0db-b3af-43cf-a9e2-f74202322a85 service nova] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7bd9a2f5-f64d-46ec-9387-4f03be6e5ff6 req-3e30f0db-b3af-43cf-a9e2-f74202322a85 service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7bd9a2f5-f64d-46ec-9387-4f03be6e5ff6 req-3e30f0db-b3af-43cf-a9e2-f74202322a85 service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-7bd9a2f5-f64d-46ec-9387-4f03be6e5ff6 req-3e30f0db-b3af-43cf-a9e2-f74202322a85 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] No waiting events found dispatching network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:51 user nova-compute[73091]: WARNING nova.compute.manager [req-7bd9a2f5-f64d-46ec-9387-4f03be6e5ff6 req-3e30f0db-b3af-43cf-a9e2-f74202322a85 service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received unexpected event network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a for instance with vm_state active and task_state None.
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updating instance_info_cache with network_info: [{"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Releasing lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Instance network_info: |[{"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] Acquired lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Refreshing network info cache for port 655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Start _get_guest_xml network_info=[{"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-82411913',display_name='tempest-VolumesAdminNegativeTest-server-82411913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-82411913',id=8,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEcHp548jOdxE73ukDOYJO+cFcGDeU2LTX6JnfUUpX/X1HTKGvmcYH/T9KuSq99aFFt8SW0xKuEUTuEWUpMtFtR7rC3en6Nkgg2f3uvJTOSS/Tkq5QWk3YDs9BCrNG2A==',key_name='tempest-keypair-1700635037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944792b19ee14226b529478fbfd50dc6',ramdisk_id='',reservation_id='r-i99nt01s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-232748453',owner_user_name='tempest-VolumesAdminNegativeTest-232748453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9782834fd235447083d0580b13d518d1',uuid=6f321a3f-b0c8-48f6-8d98-f34e12a3a485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converting VIF {"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.objects.instance [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:51 user nova-compute[73091]: DEBUG nova.policy [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1349b742d295473f959c032d8399d355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d967817fd1492ca8336336d8da7138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:52 user nova-compute[73091]:   <uuid>6f321a3f-b0c8-48f6-8d98-f34e12a3a485</uuid>
Aug 16 15:00:52 user nova-compute[73091]:   <name>instance-00000008</name>
Aug 16 15:00:52 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:52 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:52 user nova-compute[73091]:   <metadata>
Aug 16 15:00:52 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:52 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:52 user nova-compute[73091]:       <nova:name>tempest-VolumesAdminNegativeTest-server-82411913</nova:name>
Aug 16 15:00:52 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:51</nova:creationTime>
Aug 16 15:00:52 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:52 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:52 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:52 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:user uuid="9782834fd235447083d0580b13d518d1">tempest-VolumesAdminNegativeTest-232748453-project-member</nova:user>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:project uuid="944792b19ee14226b529478fbfd50dc6">tempest-VolumesAdminNegativeTest-232748453</nova:project>
Aug 16 15:00:52 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:52 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:52 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:52 user nova-compute[73091]:         <nova:port uuid="655ea32b-442a-4017-b2d9-1ee7e4d2aa8f">
Aug 16 15:00:52 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:00:52 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:52 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:52 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:52 user nova-compute[73091]:   </metadata>
Aug 16 15:00:52 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:52 user nova-compute[73091]:     <system>
Aug 16 15:00:52 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:52 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:52 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:52 user nova-compute[73091]:       <entry name="serial">6f321a3f-b0c8-48f6-8d98-f34e12a3a485</entry>
Aug 16 15:00:52 user nova-compute[73091]:       <entry name="uuid">6f321a3f-b0c8-48f6-8d98-f34e12a3a485</entry>
Aug 16 15:00:52 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:52 user nova-compute[73091]:     </system>
Aug 16 15:00:52 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:52 user nova-compute[73091]:   <os>
Aug 16 15:00:52 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:52 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:52 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:52 user nova-compute[73091]:   </os>
Aug 16 15:00:52 user nova-compute[73091]:   <features>
Aug 16 15:00:52 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:52 user nova-compute[73091]:     <apic/>
Aug 16 15:00:52 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:52 user nova-compute[73091]:   </features>
Aug 16 15:00:52 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:52 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:52 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:52 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:52 user nova-compute[73091]:   </clock>
Aug 16 15:00:52 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:52 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:52 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:52 user nova-compute[73091]:   </cpu>
Aug 16 15:00:52 user nova-compute[73091]:   <devices>
Aug 16 15:00:52 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:52 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:52 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk"/>
Aug 16 15:00:52 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:52 user nova-compute[73091]:     </disk>
Aug 16 15:00:52 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:52 user nova-compute[73091]:       <mac address="fa:16:3e:64:7c:2e"/>
Aug 16 15:00:52 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:52 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:52 user nova-compute[73091]:       <target dev="tap655ea32b-44"/>
Aug 16 15:00:52 user nova-compute[73091]:     </interface>
Aug 16 15:00:52 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:52 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/console.log" append="off"/>
Aug 16 15:00:52 user nova-compute[73091]:     </serial>
Aug 16 15:00:52 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:52 user nova-compute[73091]:     <video>
Aug 16 15:00:52 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:52 user nova-compute[73091]:     </video>
Aug 16 15:00:52 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:52 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:52 user nova-compute[73091]:     </rng>
Aug 16 15:00:52 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:52 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:52 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:52 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:52 user nova-compute[73091]:   </devices>
Aug 16 15:00:52 user nova-compute[73091]: </domain>
Aug 16 15:00:52 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-82411913',display_name='tempest-VolumesAdminNegativeTest-server-82411913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-82411913',id=8,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEcHp548jOdxE73ukDOYJO+cFcGDeU2LTX6JnfUUpX/X1HTKGvmcYH/T9KuSq99aFFt8SW0xKuEUTuEWUpMtFtR7rC3en6Nkgg2f3uvJTOSS/Tkq5QWk3YDs9BCrNG2A==',key_name='tempest-keypair-1700635037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944792b19ee14226b529478fbfd50dc6',ramdisk_id='',reservation_id='r-i99nt01s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-232748453',owner_user_name='tempest-VolumesAdminNegativeTest-232748453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9782834fd235447083d0580b13d518d1',uuid=6f321a3f-b0c8-48f6-8d98-f34e12a3a485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converting VIF {"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG os_vif [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap655ea32b-44, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap655ea32b-44, col_values=(('external_ids', {'iface-id': '655ea32b-442a-4017-b2d9-1ee7e4d2aa8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:7c:2e', 'vm-uuid': '6f321a3f-b0c8-48f6-8d98-f34e12a3a485'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:52 user nova-compute[73091]: INFO os_vif [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44')
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Creating image(s)
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "/opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "/opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "/opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No VIF found with MAC fa:16:3e:64:7c:2e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:00:52 user nova-compute[73091]: INFO nova.compute.claims [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Claim successful on node user
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.267s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.330s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk 1073741824" returned: 0 in 0.093s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updated VIF entry in instance network info cache for port 655ea32b-442a-4017-b2d9-1ee7e4d2aa8f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updating instance_info_cache with network_info: [{"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.328s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c566a907-6ce7-46f9-911a-84c6c861a95d req-6889d027-e8d9-4d67-b25c-9bb4fa589423 service nova] Releasing lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Successfully created port: 523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Cannot resize image /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lazy-loading 'migration_context' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Ensure instance console log exists: /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-1021faf6-cd91-4535-ae76-be28b7decb59 req-1fe677f1-fcab-40e6-b5ac-8f64a075632d service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1021faf6-cd91-4535-ae76-be28b7decb59 req-1fe677f1-fcab-40e6-b5ac-8f64a075632d service nova] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1021faf6-cd91-4535-ae76-be28b7decb59 req-1fe677f1-fcab-40e6-b5ac-8f64a075632d service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1021faf6-cd91-4535-ae76-be28b7decb59 req-1fe677f1-fcab-40e6-b5ac-8f64a075632d service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-1021faf6-cd91-4535-ae76-be28b7decb59 req-1fe677f1-fcab-40e6-b5ac-8f64a075632d service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] No waiting events found dispatching network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:53 user nova-compute[73091]: WARNING nova.compute.manager [req-1021faf6-cd91-4535-ae76-be28b7decb59 req-1fe677f1-fcab-40e6-b5ac-8f64a075632d service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received unexpected event network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a for instance with vm_state active and task_state None.
Aug 16 15:00:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:00:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:00:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.policy [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32add1019c1e41369c1b3a38e5dbf35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5afb4af0834ef8aa81c324976ea127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Creating image(s)
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "/opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "/opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "/opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198054.3586125, c1efefe8-9e86-4194-8c94-6eaafd4c22f7 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] VM Resumed (Lifecycle Event)
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Instance spawned successfully.
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.291s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198054.3859382, c1efefe8-9e86-4194-8c94-6eaafd4c22f7 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] VM Started (Lifecycle Event)
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Took 15.27 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:54 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.419s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:55 user nova-compute[73091]: INFO nova.compute.manager [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Took 17.29 seconds to build instance.
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-30d2e174-5db0-46c1-a5ca-126d78d52eb9 req-edb32e46-16b2-413c-967d-54fb9ffd935c service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received event network-vif-plugged-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30d2e174-5db0-46c1-a5ca-126d78d52eb9 req-edb32e46-16b2-413c-967d-54fb9ffd935c service nova] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30d2e174-5db0-46c1-a5ca-126d78d52eb9 req-edb32e46-16b2-413c-967d-54fb9ffd935c service nova] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30d2e174-5db0-46c1-a5ca-126d78d52eb9 req-edb32e46-16b2-413c-967d-54fb9ffd935c service nova] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-30d2e174-5db0-46c1-a5ca-126d78d52eb9 req-edb32e46-16b2-413c-967d-54fb9ffd935c service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] No waiting events found dispatching network-vif-plugged-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:55 user nova-compute[73091]: WARNING nova.compute.manager [req-30d2e174-5db0-46c1-a5ca-126d78d52eb9 req-edb32e46-16b2-413c-967d-54fb9ffd935c service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received unexpected event network-vif-plugged-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f for instance with vm_state building and task_state spawning.
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk 1073741824" returned: 0 in 0.095s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.517s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8253bac-80c9-46d7-82f4-21b825d2b7d0 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.582s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Successfully updated port: 523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.361s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquired lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-changed-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Refreshing instance network info cache due to event network-changed-523fec09-8da5-4ece-9c3d-6d4423ae4d98. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] Acquiring lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Cannot resize image /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lazy-loading 'migration_context' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Ensure instance console log exists: /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updating instance_info_cache with network_info: [{"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Releasing lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Instance network_info: |[{"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] Acquired lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Refreshing network info cache for port 523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Start _get_guest_xml network_info=[{"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1972798108',display_name='tempest-TestVolumeSwap-server-1972798108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1972798108',id=9,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM7iRVIi11lVOEOznzRfOMubEWwmShEkabWHSxBtRCucAvoPDZqIyUUjopeQzL5Y3jTG4WJ3zGwTbYBCtiH6g1UtVC8Yiy4m3cexKtZT0y0Wj3sSddm4Jh4+F5EtEsdTQ==',key_name='tempest-keypair-973685097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90d967817fd1492ca8336336d8da7138',ramdisk_id='',reservation_id='r-ztxk8itv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1066098404',owner_user_name='tempest-TestVolumeSwap-1066098404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1349b742d295473f959c032d8399d355',uuid=617055ab-fdaa-41ab-ac65-ebff7a233181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Converting VIF {"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lazy-loading 'pci_devices' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:56 user nova-compute[73091]:   <uuid>617055ab-fdaa-41ab-ac65-ebff7a233181</uuid>
Aug 16 15:00:56 user nova-compute[73091]:   <name>instance-00000009</name>
Aug 16 15:00:56 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:56 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:56 user nova-compute[73091]:   <metadata>
Aug 16 15:00:56 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:56 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:56 user nova-compute[73091]:       <nova:name>tempest-TestVolumeSwap-server-1972798108</nova:name>
Aug 16 15:00:56 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:56</nova:creationTime>
Aug 16 15:00:56 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:56 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:56 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:56 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:user uuid="1349b742d295473f959c032d8399d355">tempest-TestVolumeSwap-1066098404-project-member</nova:user>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:project uuid="90d967817fd1492ca8336336d8da7138">tempest-TestVolumeSwap-1066098404</nova:project>
Aug 16 15:00:56 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:56 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:56 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:56 user nova-compute[73091]:         <nova:port uuid="523fec09-8da5-4ece-9c3d-6d4423ae4d98">
Aug 16 15:00:56 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 15:00:56 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:56 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:56 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:56 user nova-compute[73091]:   </metadata>
Aug 16 15:00:56 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:56 user nova-compute[73091]:     <system>
Aug 16 15:00:56 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:56 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:56 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:56 user nova-compute[73091]:       <entry name="serial">617055ab-fdaa-41ab-ac65-ebff7a233181</entry>
Aug 16 15:00:56 user nova-compute[73091]:       <entry name="uuid">617055ab-fdaa-41ab-ac65-ebff7a233181</entry>
Aug 16 15:00:56 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:56 user nova-compute[73091]:     </system>
Aug 16 15:00:56 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:56 user nova-compute[73091]:   <os>
Aug 16 15:00:56 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:56 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:56 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:56 user nova-compute[73091]:   </os>
Aug 16 15:00:56 user nova-compute[73091]:   <features>
Aug 16 15:00:56 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:56 user nova-compute[73091]:     <apic/>
Aug 16 15:00:56 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:56 user nova-compute[73091]:   </features>
Aug 16 15:00:56 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:56 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:56 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:56 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:56 user nova-compute[73091]:   </clock>
Aug 16 15:00:56 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:56 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:56 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:56 user nova-compute[73091]:   </cpu>
Aug 16 15:00:56 user nova-compute[73091]:   <devices>
Aug 16 15:00:56 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:56 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:56 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk"/>
Aug 16 15:00:56 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:56 user nova-compute[73091]:     </disk>
Aug 16 15:00:56 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:56 user nova-compute[73091]:       <mac address="fa:16:3e:68:27:ca"/>
Aug 16 15:00:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:56 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:56 user nova-compute[73091]:       <target dev="tap523fec09-8d"/>
Aug 16 15:00:56 user nova-compute[73091]:     </interface>
Aug 16 15:00:56 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:56 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/console.log" append="off"/>
Aug 16 15:00:56 user nova-compute[73091]:     </serial>
Aug 16 15:00:56 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:56 user nova-compute[73091]:     <video>
Aug 16 15:00:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:56 user nova-compute[73091]:     </video>
Aug 16 15:00:56 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:56 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:56 user nova-compute[73091]:     </rng>
Aug 16 15:00:56 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:56 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:56 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:56 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:56 user nova-compute[73091]:   </devices>
Aug 16 15:00:56 user nova-compute[73091]: </domain>
Aug 16 15:00:56 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1972798108',display_name='tempest-TestVolumeSwap-server-1972798108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1972798108',id=9,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM7iRVIi11lVOEOznzRfOMubEWwmShEkabWHSxBtRCucAvoPDZqIyUUjopeQzL5Y3jTG4WJ3zGwTbYBCtiH6g1UtVC8Yiy4m3cexKtZT0y0Wj3sSddm4Jh4+F5EtEsdTQ==',key_name='tempest-keypair-973685097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90d967817fd1492ca8336336d8da7138',ramdisk_id='',reservation_id='r-ztxk8itv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1066098404',owner_user_name='tempest-TestVolumeSwap-1066098404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1349b742d295473f959c032d8399d355',uuid=617055ab-fdaa-41ab-ac65-ebff7a233181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Converting VIF {"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG os_vif [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap523fec09-8d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap523fec09-8d, col_values=(('external_ids', {'iface-id': '523fec09-8da5-4ece-9c3d-6d4423ae4d98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:27:ca', 'vm-uuid': '617055ab-fdaa-41ab-ac65-ebff7a233181'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:56 user nova-compute[73091]: INFO os_vif [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d')
Aug 16 15:00:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Successfully created port: 97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] No VIF found with MAC fa:16:3e:68:27:ca, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-49ae3f75-53ea-4830-86cd-38180fb1b2a0 req-124df3b1-bf31-43d0-a07d-1f5d223a9b9a service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received event network-vif-plugged-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49ae3f75-53ea-4830-86cd-38180fb1b2a0 req-124df3b1-bf31-43d0-a07d-1f5d223a9b9a service nova] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49ae3f75-53ea-4830-86cd-38180fb1b2a0 req-124df3b1-bf31-43d0-a07d-1f5d223a9b9a service nova] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49ae3f75-53ea-4830-86cd-38180fb1b2a0 req-124df3b1-bf31-43d0-a07d-1f5d223a9b9a service nova] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-49ae3f75-53ea-4830-86cd-38180fb1b2a0 req-124df3b1-bf31-43d0-a07d-1f5d223a9b9a service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] No waiting events found dispatching network-vif-plugged-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:57 user nova-compute[73091]: WARNING nova.compute.manager [req-49ae3f75-53ea-4830-86cd-38180fb1b2a0 req-124df3b1-bf31-43d0-a07d-1f5d223a9b9a service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received unexpected event network-vif-plugged-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f for instance with vm_state building and task_state spawning.
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-8cc9f867-c672-4a9a-8025-9f7401f67214 req-ad5a9786-6b0e-40c9-aa8e-cd4a64fc244c service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8cc9f867-c672-4a9a-8025-9f7401f67214 req-ad5a9786-6b0e-40c9-aa8e-cd4a64fc244c service nova] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8cc9f867-c672-4a9a-8025-9f7401f67214 req-ad5a9786-6b0e-40c9-aa8e-cd4a64fc244c service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8cc9f867-c672-4a9a-8025-9f7401f67214 req-ad5a9786-6b0e-40c9-aa8e-cd4a64fc244c service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-8cc9f867-c672-4a9a-8025-9f7401f67214 req-ad5a9786-6b0e-40c9-aa8e-cd4a64fc244c service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] No waiting events found dispatching network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:57 user nova-compute[73091]: WARNING nova.compute.manager [req-8cc9f867-c672-4a9a-8025-9f7401f67214 req-ad5a9786-6b0e-40c9-aa8e-cd4a64fc244c service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received unexpected event network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 for instance with vm_state active and task_state None.
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198058.2263987, 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] VM Resumed (Lifecycle Event)
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Instance spawned successfully.
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198058.226521, 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] VM Started (Lifecycle Event)
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updated VIF entry in instance network info cache for port 523fec09-8da5-4ece-9c3d-6d4423ae4d98. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updating instance_info_cache with network_info: [{"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-03d2a3a7-7008-48ca-b2da-cff91c4a93cc req-cc49c48a-839b-4bff-a06c-11f5f2e1bd56 service nova] Releasing lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Took 10.51 seconds to spawn the instance on the hypervisor.
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Successfully updated port: 97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquired lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:00:58 user nova-compute[73091]: INFO nova.compute.manager [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Took 12.38 seconds to build instance.
Aug 16 15:00:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e0d409-c0ba-494c-a681-7077bc4f7c14 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.728s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updating instance_info_cache with network_info: [{"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Releasing lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Instance network_info: |[{"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Start _get_guest_xml network_info=[{"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:00:59 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:59 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1499541005',display_name='tempest-VolumesAssistedSnapshotsTest-server-1499541005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1499541005',id=10,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUs1qi9YNn8GgsNz7z9LZCBSamIgMo8nTjvw10mzK/HgkFiilUEswr0/FxG8S/o3M7kCcKj8J7VqO/e/9kplPm0gfPMvDVJUTFLDOG0BKyQ/eRaMjDZ+b2zkvedW4ZVKQ==',key_name='tempest-keypair-1292302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c5afb4af0834ef8aa81c324976ea127',ramdisk_id='',reservation_id='r-bbm4jht0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1605885550',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1605885550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32add1019c1e41369c1b3a38e5dbf35e',uuid=555e458d-ddd4-41a7-8d7a-b763c3090f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Converting VIF {"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lazy-loading 'pci_devices' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:00:59 user nova-compute[73091]:   <uuid>555e458d-ddd4-41a7-8d7a-b763c3090f3d</uuid>
Aug 16 15:00:59 user nova-compute[73091]:   <name>instance-0000000a</name>
Aug 16 15:00:59 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:00:59 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:00:59 user nova-compute[73091]:   <metadata>
Aug 16 15:00:59 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:00:59 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:00:59 user nova-compute[73091]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1499541005</nova:name>
Aug 16 15:00:59 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:00:59</nova:creationTime>
Aug 16 15:00:59 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:00:59 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:00:59 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:00:59 user nova-compute[73091]:       <nova:owner>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:user uuid="32add1019c1e41369c1b3a38e5dbf35e">tempest-VolumesAssistedSnapshotsTest-1605885550-project-member</nova:user>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:project uuid="3c5afb4af0834ef8aa81c324976ea127">tempest-VolumesAssistedSnapshotsTest-1605885550</nova:project>
Aug 16 15:00:59 user nova-compute[73091]:       </nova:owner>
Aug 16 15:00:59 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:00:59 user nova-compute[73091]:       <nova:ports>
Aug 16 15:00:59 user nova-compute[73091]:         <nova:port uuid="97c80a4f-c105-435d-ae7c-e0ef30d1fb9f">
Aug 16 15:00:59 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:00:59 user nova-compute[73091]:         </nova:port>
Aug 16 15:00:59 user nova-compute[73091]:       </nova:ports>
Aug 16 15:00:59 user nova-compute[73091]:     </nova:instance>
Aug 16 15:00:59 user nova-compute[73091]:   </metadata>
Aug 16 15:00:59 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:00:59 user nova-compute[73091]:     <system>
Aug 16 15:00:59 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:00:59 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:00:59 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:00:59 user nova-compute[73091]:       <entry name="serial">555e458d-ddd4-41a7-8d7a-b763c3090f3d</entry>
Aug 16 15:00:59 user nova-compute[73091]:       <entry name="uuid">555e458d-ddd4-41a7-8d7a-b763c3090f3d</entry>
Aug 16 15:00:59 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:00:59 user nova-compute[73091]:     </system>
Aug 16 15:00:59 user nova-compute[73091]:   </sysinfo>
Aug 16 15:00:59 user nova-compute[73091]:   <os>
Aug 16 15:00:59 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:00:59 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:00:59 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:00:59 user nova-compute[73091]:   </os>
Aug 16 15:00:59 user nova-compute[73091]:   <features>
Aug 16 15:00:59 user nova-compute[73091]:     <acpi/>
Aug 16 15:00:59 user nova-compute[73091]:     <apic/>
Aug 16 15:00:59 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:00:59 user nova-compute[73091]:   </features>
Aug 16 15:00:59 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:00:59 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:00:59 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:00:59 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:00:59 user nova-compute[73091]:   </clock>
Aug 16 15:00:59 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:00:59 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:00:59 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:00:59 user nova-compute[73091]:   </cpu>
Aug 16 15:00:59 user nova-compute[73091]:   <devices>
Aug 16 15:00:59 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:00:59 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:00:59 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk"/>
Aug 16 15:00:59 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:00:59 user nova-compute[73091]:     </disk>
Aug 16 15:00:59 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:00:59 user nova-compute[73091]:       <mac address="fa:16:3e:e3:97:cc"/>
Aug 16 15:00:59 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:59 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:00:59 user nova-compute[73091]:       <target dev="tap97c80a4f-c1"/>
Aug 16 15:00:59 user nova-compute[73091]:     </interface>
Aug 16 15:00:59 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:00:59 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/console.log" append="off"/>
Aug 16 15:00:59 user nova-compute[73091]:     </serial>
Aug 16 15:00:59 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:00:59 user nova-compute[73091]:     <video>
Aug 16 15:00:59 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:00:59 user nova-compute[73091]:     </video>
Aug 16 15:00:59 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:00:59 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:00:59 user nova-compute[73091]:     </rng>
Aug 16 15:00:59 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:00:59 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:00:59 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:00:59 user nova-compute[73091]:     </memballoon>
Aug 16 15:00:59 user nova-compute[73091]:   </devices>
Aug 16 15:00:59 user nova-compute[73091]: </domain>
Aug 16 15:00:59 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1499541005',display_name='tempest-VolumesAssistedSnapshotsTest-server-1499541005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1499541005',id=10,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUs1qi9YNn8GgsNz7z9LZCBSamIgMo8nTjvw10mzK/HgkFiilUEswr0/FxG8S/o3M7kCcKj8J7VqO/e/9kplPm0gfPMvDVJUTFLDOG0BKyQ/eRaMjDZ+b2zkvedW4ZVKQ==',key_name='tempest-keypair-1292302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c5afb4af0834ef8aa81c324976ea127',ramdisk_id='',reservation_id='r-bbm4jht0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1605885550',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1605885550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32add1019c1e41369c1b3a38e5dbf35e',uuid=555e458d-ddd4-41a7-8d7a-b763c3090f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Converting VIF {"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG os_vif [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97c80a4f-c1, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97c80a4f-c1, col_values=(('external_ids', {'iface-id': '97c80a4f-c105-435d-ae7c-e0ef30d1fb9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:97:cc', 'vm-uuid': '555e458d-ddd4-41a7-8d7a-b763c3090f3d'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: INFO os_vif [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1')
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-changed-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Refreshing instance network info cache due to event network-changed-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] Acquiring lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] Acquired lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Refreshing network info cache for port 97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] No VIF found with MAC fa:16:3e:e3:97:cc, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-91c0de1d-6c56-4788-9a60-db80f2365b4a req-eea4f523-90ee-4a9e-aaa9-2a062e07d6ec service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91c0de1d-6c56-4788-9a60-db80f2365b4a req-eea4f523-90ee-4a9e-aaa9-2a062e07d6ec service nova] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91c0de1d-6c56-4788-9a60-db80f2365b4a req-eea4f523-90ee-4a9e-aaa9-2a062e07d6ec service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91c0de1d-6c56-4788-9a60-db80f2365b4a req-eea4f523-90ee-4a9e-aaa9-2a062e07d6ec service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-91c0de1d-6c56-4788-9a60-db80f2365b4a req-eea4f523-90ee-4a9e-aaa9-2a062e07d6ec service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] No waiting events found dispatching network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:00:59 user nova-compute[73091]: WARNING nova.compute.manager [req-91c0de1d-6c56-4788-9a60-db80f2365b4a req-eea4f523-90ee-4a9e-aaa9-2a062e07d6ec service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received unexpected event network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 for instance with vm_state active and task_state None.
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updated VIF entry in instance network info cache for port 97c80a4f-c105-435d-ae7c-e0ef30d1fb9f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:00:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updating instance_info_cache with network_info: [{"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-877d3416-5c9c-4513-9685-e64d12e9b2fe req-89b6c63c-59da-419f-a72f-5ae652301fb6 service nova] Releasing lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd925932-4b9e-4a3d-8aa0-13c9b22a41c5 req-72b7b582-417d-45ef-b1aa-dea59e85e35c service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd925932-4b9e-4a3d-8aa0-13c9b22a41c5 req-72b7b582-417d-45ef-b1aa-dea59e85e35c service nova] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd925932-4b9e-4a3d-8aa0-13c9b22a41c5 req-72b7b582-417d-45ef-b1aa-dea59e85e35c service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd925932-4b9e-4a3d-8aa0-13c9b22a41c5 req-72b7b582-417d-45ef-b1aa-dea59e85e35c service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd925932-4b9e-4a3d-8aa0-13c9b22a41c5 req-72b7b582-417d-45ef-b1aa-dea59e85e35c service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] No waiting events found dispatching network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:01 user nova-compute[73091]: WARNING nova.compute.manager [req-fd925932-4b9e-4a3d-8aa0-13c9b22a41c5 req-72b7b582-417d-45ef-b1aa-dea59e85e35c service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received unexpected event network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f for instance with vm_state building and task_state spawning.
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198061.539401, 617055ab-fdaa-41ab-ac65-ebff7a233181 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:01:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] VM Resumed (Lifecycle Event)
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:01:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Instance spawned successfully.
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198061.5464108, 617055ab-fdaa-41ab-ac65-ebff7a233181 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:01:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] VM Started (Lifecycle Event)
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:01:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:01:01 user nova-compute[73091]: INFO nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Took 9.56 seconds to spawn the instance on the hypervisor.
Aug 16 15:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:02 user nova-compute[73091]: INFO nova.compute.manager [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Took 11.51 seconds to build instance.
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d49723f6-f007-42cc-ac8a-742b9913167b tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.031s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d4a397f-90d7-4bb2-94da-c5b64d442b28 req-0fff5877-fa3d-4d50-b2dd-466b038d8129 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d4a397f-90d7-4bb2-94da-c5b64d442b28 req-0fff5877-fa3d-4d50-b2dd-466b038d8129 service nova] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d4a397f-90d7-4bb2-94da-c5b64d442b28 req-0fff5877-fa3d-4d50-b2dd-466b038d8129 service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d4a397f-90d7-4bb2-94da-c5b64d442b28 req-0fff5877-fa3d-4d50-b2dd-466b038d8129 service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d4a397f-90d7-4bb2-94da-c5b64d442b28 req-0fff5877-fa3d-4d50-b2dd-466b038d8129 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] No waiting events found dispatching network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:03 user nova-compute[73091]: WARNING nova.compute.manager [req-3d4a397f-90d7-4bb2-94da-c5b64d442b28 req-0fff5877-fa3d-4d50-b2dd-466b038d8129 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received unexpected event network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f for instance with vm_state building and task_state spawning.
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198064.159241, 555e458d-ddd4-41a7-8d7a-b763c3090f3d => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] VM Resumed (Lifecycle Event)
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Instance spawned successfully.
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198064.1647263, 555e458d-ddd4-41a7-8d7a-b763c3090f3d => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] VM Started (Lifecycle Event)
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Took 10.23 seconds to spawn the instance on the hypervisor.
Aug 16 15:01:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:01:04 user nova-compute[73091]: INFO nova.compute.manager [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Took 12.30 seconds to build instance.
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d140036a-68cf-47a5-b015-9d4f74dedefb tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.652s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:01:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7572MB free_disk=25.869701385498047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 617055ab-fdaa-41ab-ac65-ebff7a233181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:01:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:01:08 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:01:08 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:01:08 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:01:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.009s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:01:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbb733ab-5e83-4687-b9a6-6c685d5f6bc7 req-e2048ee7-d8aa-43df-972d-2dd5f463e707 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbb733ab-5e83-4687-b9a6-6c685d5f6bc7 req-e2048ee7-d8aa-43df-972d-2dd5f463e707 service nova] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbb733ab-5e83-4687-b9a6-6c685d5f6bc7 req-e2048ee7-d8aa-43df-972d-2dd5f463e707 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbb733ab-5e83-4687-b9a6-6c685d5f6bc7 req-e2048ee7-d8aa-43df-972d-2dd5f463e707 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbb733ab-5e83-4687-b9a6-6c685d5f6bc7 req-e2048ee7-d8aa-43df-972d-2dd5f463e707 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] No waiting events found dispatching network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:10 user nova-compute[73091]: WARNING nova.compute.manager [req-bbb733ab-5e83-4687-b9a6-6c685d5f6bc7 req-e2048ee7-d8aa-43df-972d-2dd5f463e707 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received unexpected event network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 for instance with vm_state active and task_state None.
Aug 16 15:01:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updating instance_info_cache with network_info: [{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:01:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] No waiting events found dispatching network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:12 user nova-compute[73091]: WARNING nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received unexpected event network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 for instance with vm_state active and task_state None.
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] No waiting events found dispatching network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:12 user nova-compute[73091]: WARNING nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received unexpected event network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c for instance with vm_state active and task_state None.
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] No waiting events found dispatching network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:12 user nova-compute[73091]: WARNING nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received unexpected event network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c for instance with vm_state active and task_state None.
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] No waiting events found dispatching network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:12 user nova-compute[73091]: WARNING nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received unexpected event network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 for instance with vm_state active and task_state None.
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] No waiting events found dispatching network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:12 user nova-compute[73091]: WARNING nova.compute.manager [req-3e84936c-78a2-4bc4-acc7-cbb9e3120729 req-649b8dda-da28-4d6d-9d4e-34b5dbdd7e83 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received unexpected event network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 for instance with vm_state active and task_state None.
Aug 16 15:01:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] No waiting events found dispatching network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:14 user nova-compute[73091]: WARNING nova.compute.manager [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received unexpected event network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 for instance with vm_state active and task_state None.
Aug 16 15:01:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] No waiting events found dispatching network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:01:14 user nova-compute[73091]: WARNING nova.compute.manager [req-534a63c3-addd-4894-b4f6-10853413045f req-91473157-3543-4bee-af97-08e74926c1f7 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received unexpected event network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 for instance with vm_state active and task_state None.
Aug 16 15:01:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:01:43 user nova-compute[73091]: INFO nova.compute.claims [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Claim successful on node user
Aug 16 15:01:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:01:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:01:44 user nova-compute[73091]: INFO nova.virt.block_device [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Booting with volume 089fd372-308f-4c51-adb3-86e1e6683570 at /dev/vda
Aug 16 15:01:44 user nova-compute[73091]: DEBUG nova.policy [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82a129984a7c4d1ba3ce32355ba457ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cfbbbb30714fd99abc17e26464726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:01:44 user nova-compute[73091]: DEBUG os_brick.utils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:01:44 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpkgdl8gc2/privsep.sock']
Aug 16 15:01:44 user sudo[84404]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpkgdl8gc2/privsep.sock
Aug 16 15:01:44 user sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 15:01:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully created port: a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully created port: 612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:01:46 user sudo[84404]: pam_unix(sudo:session): session closed for user root
Aug 16 15:01:46 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Spawned new privsep daemon via rootwrap
Aug 16 15:01:46 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 15:01:46 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 15:01:46 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 15:01:46 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84412
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bdba5b-0e38-4883-9783-956b929c5932]: (2,) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33440aa-b339-41e6-9312-0489de58c058]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:01:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.nvmeof [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaf4130-e296-4dec-aea3-5ea6517c6cf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c094136b-8951-4735-af02-a6bab3637c1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a182da0-2b00-43c0-8c39-11a2863047eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:01:46 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:01:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d14222a-5ddb-43a0-92f2-f6564e593c8b]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== get_connector_properties: return (2094ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:01:46 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating existing volume attachment record: 9b728c53-85c1-486d-87a8-81f40d362c6f {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:01:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully created port: 80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:01:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully created port: 40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:01:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully created port: 7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-a0611e7d-1429-479a-aa0e-edf596d174aa. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93b508e2-4860-44f8-adf7-6731a2c51c8e req-1b0c82db-394e-4900-b266-897352099ab9 service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: 2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: 6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-2cf09406-f304-4b68-b7d7-1a90cc0f98e2. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port 2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: 612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-6a41a498-f665-45d9-987a-f4b09ecb2543. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port 6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a2434fe-d681-45b6-81d6-781a096d273a req-f6f96099-a49f-43c9-a5d6-4ddcffe162d1 service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: 80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: 40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-612c0961-a4b9-4616-bcdb-2ca50837bfd3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port 612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-80e7b6b1-0bd7-47ae-8d10-f40842a8d447. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port 80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-40860a54-5116-4c1b-8869-30984fe99d39. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port 40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Successfully updated port: 7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:01:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7840c804-63bd-4fe6-83bd-ee8404956abc req-4602c264-3c13-4418-803b-f97d9f0eed5e service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:01:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:01:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:01:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:01:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-7bfbe452-abe5-4e67-8274-cf4f927616d1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:01:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance network_info: |[{"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port 7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updated VIF entry in instance network info cache for port 7bfbe452-abe5-4e67-8274-cf4f927616d1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:01:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-40b9498c-4806-4719-9ab3-7e52395c19c3 req-e0feba4a-3a79-41c7-9bc9-06124124d0a5 service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:01:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:01 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=6825MB free_disk=25.722000122070312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 617055ab-fdaa-41ab-ac65-ebff7a233181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:02:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:02:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:03 user nova-compute[73091]: INFO nova.compute.manager [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] instance snapshotting
Aug 16 15:02:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Beginning live snapshot process
Aug 16 15:02:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplvgz52w2/f16ef2b776f244549bb74fa91ab5ba70.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplvgz52w2/f16ef2b776f244549bb74fa91ab5ba70.delta 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 15:02:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73091) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 15:02:04 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] UEFI support detected
Aug 16 15:02:04 user nova-compute[73091]: INFO nova.compute.manager [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Rescuing
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:02:05 user nova-compute[73091]: INFO nova.compute.claims [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Claim successful on node user
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] COPY block job progress, current cursor: 17301504 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.927s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:02:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.policy [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '058c604dd70b49f6b8fa356a81344415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6131b7ede5ec41eb9441f103318fe81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-48a68b1a-7df7-4781-a333-0c2ffc343e3f req-5dc62706-b8ae-4b9c-b0e2-6bd41ab0e9eb service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-unplugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48a68b1a-7df7-4781-a333-0c2ffc343e3f req-5dc62706-b8ae-4b9c-b0e2-6bd41ab0e9eb service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48a68b1a-7df7-4781-a333-0c2ffc343e3f req-5dc62706-b8ae-4b9c-b0e2-6bd41ab0e9eb service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48a68b1a-7df7-4781-a333-0c2ffc343e3f req-5dc62706-b8ae-4b9c-b0e2-6bd41ab0e9eb service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-48a68b1a-7df7-4781-a333-0c2ffc343e3f req-5dc62706-b8ae-4b9c-b0e2-6bd41ab0e9eb service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-unplugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:06 user nova-compute[73091]: WARNING nova.compute.manager [req-48a68b1a-7df7-4781-a333-0c2ffc343e3f req-5dc62706-b8ae-4b9c-b0e2-6bd41ab0e9eb service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-unplugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state active and task_state rescuing.
Aug 16 15:02:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:02:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Creating image(s)
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "/opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "/opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "/opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:02:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplvgz52w2/f16ef2b776f244549bb74fa91ab5ba70.delta /opt/stack/data/nova/instances/snapshots/tmplvgz52w2/f16ef2b776f244549bb74fa91ab5ba70 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance destroyed successfully.
Aug 16 15:02:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Attempting rescue
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:02:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Creating image(s)
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk 1073741824" returned: 0 in 0.056s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.167s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Successfully created port: 98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.234s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Cannot resize image /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lazy-loading 'migration_context' on Instance uuid 9abe1902-d0cf-4d99-abab-2f83fe840476 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue" returned: 0 in 0.132s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'migration_context' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Ensure instance console log exists: /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Start _get_guest_xml network_info=[{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:01:a6:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'resources' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'numa_topology' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplvgz52w2/f16ef2b776f244549bb74fa91ab5ba70.delta /opt/stack/data/nova/instances/snapshots/tmplvgz52w2/f16ef2b776f244549bb74fa91ab5ba70" returned: 0 in 0.784s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Snapshot extracted, beginning image upload
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056364814',display_name='tempest-ServerRescueNegativeTestJSON-server-2056364814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056364814',id=5,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-tz06aexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:35Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=90c2173a-a2c8-4162-8d81-640cc85ee05a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:01:a6:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:01:a6:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'pci_devices' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:02:07 user nova-compute[73091]:   <uuid>90c2173a-a2c8-4162-8d81-640cc85ee05a</uuid>
Aug 16 15:02:07 user nova-compute[73091]:   <name>instance-00000005</name>
Aug 16 15:02:07 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:02:07 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:02:07 user nova-compute[73091]:   <metadata>
Aug 16 15:02:07 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:02:07 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:02:07 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2056364814</nova:name>
Aug 16 15:02:07 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:02:07</nova:creationTime>
Aug 16 15:02:07 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:02:07 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:02:07 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:02:07 user nova-compute[73091]:       <nova:owner>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:user uuid="9348c14ed1dc496ebf20d26e3b31779a">tempest-ServerRescueNegativeTestJSON-789793483-project-member</nova:user>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:project uuid="4cabeffd95264d63aa6802f8a91387e9">tempest-ServerRescueNegativeTestJSON-789793483</nova:project>
Aug 16 15:02:07 user nova-compute[73091]:       </nova:owner>
Aug 16 15:02:07 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:02:07 user nova-compute[73091]:       <nova:ports>
Aug 16 15:02:07 user nova-compute[73091]:         <nova:port uuid="0033d35a-c433-418f-8abf-383712f7aa19">
Aug 16 15:02:07 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:02:07 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:07 user nova-compute[73091]:       </nova:ports>
Aug 16 15:02:07 user nova-compute[73091]:     </nova:instance>
Aug 16 15:02:07 user nova-compute[73091]:   </metadata>
Aug 16 15:02:07 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:02:07 user nova-compute[73091]:     <system>
Aug 16 15:02:07 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:02:07 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:02:07 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:02:07 user nova-compute[73091]:       <entry name="serial">90c2173a-a2c8-4162-8d81-640cc85ee05a</entry>
Aug 16 15:02:07 user nova-compute[73091]:       <entry name="uuid">90c2173a-a2c8-4162-8d81-640cc85ee05a</entry>
Aug 16 15:02:07 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:02:07 user nova-compute[73091]:     </system>
Aug 16 15:02:07 user nova-compute[73091]:   </sysinfo>
Aug 16 15:02:07 user nova-compute[73091]:   <os>
Aug 16 15:02:07 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:02:07 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:02:07 user nova-compute[73091]:   </os>
Aug 16 15:02:07 user nova-compute[73091]:   <features>
Aug 16 15:02:07 user nova-compute[73091]:     <acpi/>
Aug 16 15:02:07 user nova-compute[73091]:     <apic/>
Aug 16 15:02:07 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:02:07 user nova-compute[73091]:   </features>
Aug 16 15:02:07 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:02:07 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:02:07 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:02:07 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:02:07 user nova-compute[73091]:   </clock>
Aug 16 15:02:07 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:02:07 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:02:07 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:02:07 user nova-compute[73091]:   </cpu>
Aug 16 15:02:07 user nova-compute[73091]:   <devices>
Aug 16 15:02:07 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:02:07 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:02:07 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue"/>
Aug 16 15:02:07 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:02:07 user nova-compute[73091]:     </disk>
Aug 16 15:02:07 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:02:07 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:02:07 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk"/>
Aug 16 15:02:07 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:02:07 user nova-compute[73091]:     </disk>
Aug 16 15:02:07 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:07 user nova-compute[73091]:       <mac address="fa:16:3e:01:a6:0b"/>
Aug 16 15:02:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:07 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:07 user nova-compute[73091]:       <target dev="tap0033d35a-c4"/>
Aug 16 15:02:07 user nova-compute[73091]:     </interface>
Aug 16 15:02:07 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:02:07 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/console.log" append="off"/>
Aug 16 15:02:07 user nova-compute[73091]:     </serial>
Aug 16 15:02:07 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:02:07 user nova-compute[73091]:     <video>
Aug 16 15:02:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:07 user nova-compute[73091]:     </video>
Aug 16 15:02:07 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:02:07 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:02:07 user nova-compute[73091]:     </rng>
Aug 16 15:02:07 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:02:07 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:02:07 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:02:07 user nova-compute[73091]:     </memballoon>
Aug 16 15:02:07 user nova-compute[73091]:   </devices>
Aug 16 15:02:07 user nova-compute[73091]: </domain>
Aug 16 15:02:07 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:02:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance destroyed successfully.
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:01:a6:0b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Successfully updated port: 98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "refresh_cache-9abe1902-d0cf-4d99-abab-2f83fe840476" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquired lock "refresh_cache-9abe1902-d0cf-4d99-abab-2f83fe840476" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received event network-changed-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Refreshing instance network info cache due to event network-changed-98b25495-8df5-42bc-b7e6-d08cf1f783dd. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] Acquiring lock "refresh_cache-9abe1902-d0cf-4d99-abab-2f83fe840476" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-391db129-50df-4578-8be6-5a12a999cf24 req-234c0bfe-d10b-4654-ac42-d9503c77c1a6 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-391db129-50df-4578-8be6-5a12a999cf24 req-234c0bfe-d10b-4654-ac42-d9503c77c1a6 service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-391db129-50df-4578-8be6-5a12a999cf24 req-234c0bfe-d10b-4654-ac42-d9503c77c1a6 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-391db129-50df-4578-8be6-5a12a999cf24 req-234c0bfe-d10b-4654-ac42-d9503c77c1a6 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-391db129-50df-4578-8be6-5a12a999cf24 req-234c0bfe-d10b-4654-ac42-d9503c77c1a6 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:08 user nova-compute[73091]: WARNING nova.compute.manager [req-391db129-50df-4578-8be6-5a12a999cf24 req-234c0bfe-d10b-4654-ac42-d9503c77c1a6 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state active and task_state rescuing.
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Updating instance_info_cache with network_info: [{"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Releasing lock "refresh_cache-9abe1902-d0cf-4d99-abab-2f83fe840476" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Instance network_info: |[{"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] Acquired lock "refresh_cache-9abe1902-d0cf-4d99-abab-2f83fe840476" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Refreshing network info cache for port 98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Start _get_guest_xml network_info=[{"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:02:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1971091729',display_name='tempest-ServersNegativeTestJSON-server-1971091729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1971091729',id=12,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6131b7ede5ec41eb9441f103318fe81f',ramdisk_id='',reservation_id='r-042mo9ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-290315528',owner_user_name='tempest-ServersNegativeTestJSON-290315528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:02:06Z,user_data=None,user_id='058c604dd70b49f6b8fa356a81344415',uuid=9abe1902-d0cf-4d99-abab-2f83fe840476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converting VIF {"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lazy-loading 'pci_devices' on Instance uuid 9abe1902-d0cf-4d99-abab-2f83fe840476 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:02:08 user nova-compute[73091]:   <uuid>9abe1902-d0cf-4d99-abab-2f83fe840476</uuid>
Aug 16 15:02:08 user nova-compute[73091]:   <name>instance-0000000c</name>
Aug 16 15:02:08 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:02:08 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:02:08 user nova-compute[73091]:   <metadata>
Aug 16 15:02:08 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:02:08 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:02:08 user nova-compute[73091]:       <nova:name>tempest-ServersNegativeTestJSON-server-1971091729</nova:name>
Aug 16 15:02:08 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:02:08</nova:creationTime>
Aug 16 15:02:08 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:02:08 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:02:08 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:02:08 user nova-compute[73091]:       <nova:owner>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:user uuid="058c604dd70b49f6b8fa356a81344415">tempest-ServersNegativeTestJSON-290315528-project-member</nova:user>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:project uuid="6131b7ede5ec41eb9441f103318fe81f">tempest-ServersNegativeTestJSON-290315528</nova:project>
Aug 16 15:02:08 user nova-compute[73091]:       </nova:owner>
Aug 16 15:02:08 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:02:08 user nova-compute[73091]:       <nova:ports>
Aug 16 15:02:08 user nova-compute[73091]:         <nova:port uuid="98b25495-8df5-42bc-b7e6-d08cf1f783dd">
Aug 16 15:02:08 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 15:02:08 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:08 user nova-compute[73091]:       </nova:ports>
Aug 16 15:02:08 user nova-compute[73091]:     </nova:instance>
Aug 16 15:02:08 user nova-compute[73091]:   </metadata>
Aug 16 15:02:08 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:02:08 user nova-compute[73091]:     <system>
Aug 16 15:02:08 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:02:08 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:02:08 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:02:08 user nova-compute[73091]:       <entry name="serial">9abe1902-d0cf-4d99-abab-2f83fe840476</entry>
Aug 16 15:02:08 user nova-compute[73091]:       <entry name="uuid">9abe1902-d0cf-4d99-abab-2f83fe840476</entry>
Aug 16 15:02:08 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:02:08 user nova-compute[73091]:     </system>
Aug 16 15:02:08 user nova-compute[73091]:   </sysinfo>
Aug 16 15:02:08 user nova-compute[73091]:   <os>
Aug 16 15:02:08 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:02:08 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:02:08 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:02:08 user nova-compute[73091]:   </os>
Aug 16 15:02:08 user nova-compute[73091]:   <features>
Aug 16 15:02:08 user nova-compute[73091]:     <acpi/>
Aug 16 15:02:08 user nova-compute[73091]:     <apic/>
Aug 16 15:02:08 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:02:08 user nova-compute[73091]:   </features>
Aug 16 15:02:08 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:02:08 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:02:08 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:02:08 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:02:08 user nova-compute[73091]:   </clock>
Aug 16 15:02:08 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:02:08 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:02:08 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:02:08 user nova-compute[73091]:   </cpu>
Aug 16 15:02:08 user nova-compute[73091]:   <devices>
Aug 16 15:02:08 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:02:08 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:02:08 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk"/>
Aug 16 15:02:08 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:02:08 user nova-compute[73091]:     </disk>
Aug 16 15:02:08 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:08 user nova-compute[73091]:       <mac address="fa:16:3e:e1:76:da"/>
Aug 16 15:02:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:08 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:08 user nova-compute[73091]:       <target dev="tap98b25495-8d"/>
Aug 16 15:02:08 user nova-compute[73091]:     </interface>
Aug 16 15:02:08 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:02:08 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/console.log" append="off"/>
Aug 16 15:02:08 user nova-compute[73091]:     </serial>
Aug 16 15:02:08 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:02:08 user nova-compute[73091]:     <video>
Aug 16 15:02:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:08 user nova-compute[73091]:     </video>
Aug 16 15:02:08 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:02:08 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:02:08 user nova-compute[73091]:     </rng>
Aug 16 15:02:08 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:02:08 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:02:08 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:02:08 user nova-compute[73091]:     </memballoon>
Aug 16 15:02:08 user nova-compute[73091]:   </devices>
Aug 16 15:02:08 user nova-compute[73091]: </domain>
Aug 16 15:02:08 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1971091729',display_name='tempest-ServersNegativeTestJSON-server-1971091729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1971091729',id=12,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6131b7ede5ec41eb9441f103318fe81f',ramdisk_id='',reservation_id='r-042mo9ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-290315528',owner_user_name='tempest-ServersNegativeTestJSON-290315528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:02:06Z,user_data=None,user_id='058c604dd70b49f6b8fa356a81344415',uuid=9abe1902-d0cf-4d99-abab-2f83fe840476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converting VIF {"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG os_vif [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98b25495-8d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98b25495-8d, col_values=(('external_ids', {'iface-id': '98b25495-8df5-42bc-b7e6-d08cf1f783dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:76:da', 'vm-uuid': '9abe1902-d0cf-4d99-abab-2f83fe840476'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:08 user nova-compute[73091]: INFO os_vif [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d')
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] No VIF found with MAC fa:16:3e:e1:76:da, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lazy-loading 'flavor' on Instance uuid e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Updated VIF entry in instance network info cache for port 98b25495-8df5-42bc-b7e6-d08cf1f783dd. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Updating instance_info_cache with network_info: [{"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acaa48f8-179f-4998-82c4-47851664e303 req-c537bc5a-8611-4063-80e7-14f2b219b5e5 service nova] Releasing lock "refresh_cache-9abe1902-d0cf-4d99-abab-2f83fe840476" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:09 user nova-compute[73091]: INFO nova.compute.manager [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Attaching volume bdf31c24-1811-429b-8f34-61bb8ef4a3ca to /dev/vdb
Aug 16 15:02:09 user nova-compute[73091]: DEBUG os_brick.utils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f513c0c-151f-43f8-9121-ca00414b05da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[505002a6-ea1e-4583-96d1-05028dfe23d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f75f3-03a8-4ce5-b4d0-aa3a997460a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[31745376-c537-45d7-8b9b-fc61b1d8133a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:09 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6834726-6fa5-4882-bf77-25c78ac07909]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG os_brick.utils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:09 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Updating existing volume attachment record: 910376ff-d042-4f48-932d-058fcd08b768 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Snapshot image upload complete
Aug 16 15:02:10 user nova-compute[73091]: INFO nova.compute.manager [None req-fd86b1ba-f50a-4bbf-9cf4-441b1724dd6d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Took 6.68 seconds to snapshot the instance on the hypervisor.
Aug 16 15:02:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:10 user nova-compute[73091]: WARNING nova.compute.manager [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state active and task_state rescuing.
Aug 16 15:02:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:10 user nova-compute[73091]: WARNING nova.compute.manager [req-fffe390e-3979-4232-88af-09244c72f4e0 req-cae4af49-7fa5-4bf5-87a4-f02601307d4b service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state active and task_state rescuing.
Aug 16 15:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-67b28352-0037-4cd3-977c-7ae3869c18d5 req-2209fb93-c038-4441-83e6-b2ec7661db91 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received event network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67b28352-0037-4cd3-977c-7ae3869c18d5 req-2209fb93-c038-4441-83e6-b2ec7661db91 service nova] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67b28352-0037-4cd3-977c-7ae3869c18d5 req-2209fb93-c038-4441-83e6-b2ec7661db91 service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67b28352-0037-4cd3-977c-7ae3869c18d5 req-2209fb93-c038-4441-83e6-b2ec7661db91 service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-67b28352-0037-4cd3-977c-7ae3869c18d5 req-2209fb93-c038-4441-83e6-b2ec7661db91 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] No waiting events found dispatching network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:10 user nova-compute[73091]: WARNING nova.compute.manager [req-67b28352-0037-4cd3-977c-7ae3869c18d5 req-2209fb93-c038-4441-83e6-b2ec7661db91 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received unexpected event network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd for instance with vm_state building and task_state spawning.
Aug 16 15:02:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for 90c2173a-a2c8-4162-8d81-640cc85ee05a due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198132.5129068, 90c2173a-a2c8-4162-8d81-640cc85ee05a => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] VM Resumed (Lifecycle Event)
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a17e6f80-b71e-4e79-b1f7-612253258415 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:02:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198132.518142, 90c2173a-a2c8-4162-8d81-640cc85ee05a => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] VM Started (Lifecycle Event)
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198132.9564152, 9abe1902-d0cf-4d99-abab-2f83fe840476 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] VM Resumed (Lifecycle Event)
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:02:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Instance spawned successfully.
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:13 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198132.9602644, 9abe1902-d0cf-4d99-abab-2f83fe840476 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:13 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] VM Started (Lifecycle Event)
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-46be16d1-1aee-46fa-9980-1a633cea935b req-7cc8cfcd-67a1-4db1-b6e7-7d8f0425701c service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received event network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46be16d1-1aee-46fa-9980-1a633cea935b req-7cc8cfcd-67a1-4db1-b6e7-7d8f0425701c service nova] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46be16d1-1aee-46fa-9980-1a633cea935b req-7cc8cfcd-67a1-4db1-b6e7-7d8f0425701c service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46be16d1-1aee-46fa-9980-1a633cea935b req-7cc8cfcd-67a1-4db1-b6e7-7d8f0425701c service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-46be16d1-1aee-46fa-9980-1a633cea935b req-7cc8cfcd-67a1-4db1-b6e7-7d8f0425701c service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] No waiting events found dispatching network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:13 user nova-compute[73091]: WARNING nova.compute.manager [req-46be16d1-1aee-46fa-9980-1a633cea935b req-7cc8cfcd-67a1-4db1-b6e7-7d8f0425701c service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received unexpected event network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd for instance with vm_state building and task_state spawning.
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:02:13 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:02:13 user nova-compute[73091]: INFO nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:13 user nova-compute[73091]: INFO nova.compute.manager [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Took 8.28 seconds to build instance.
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9ed22d12-c4be-4775-986b-05e2331c7ab5 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.392s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:13 user nova-compute[73091]: INFO nova.virt.block_device [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Booting with volume 86e53a67-30bc-4171-b17e-7bd52f40f73f at /dev/vdb
Aug 16 15:02:13 user nova-compute[73091]: DEBUG os_brick.utils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b9c06-5aa5-4aa4-90a6-120c05cd6951]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2332dba1-1edd-428f-af6d-17c6a6bb3a79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e17def-ad43-441c-be10-9338491345a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[352dcecf-da3b-4592-8c36-b8e93d14ed06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:13 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0ca094-06f9-4f76-bc81-ea539614415d]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG os_brick.utils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:13 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating existing volume attachment record: 171759bf-f2e3-43e0-8c6c-bc6d23394858 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-changed-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Refreshing instance network info cache due to event network-changed-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:02:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Refreshing network info cache for port b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:02:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updated VIF entry in instance network info cache for port b2c5eaab-2de0-4764-9f7e-befb33ef9e7c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:02:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d4a4477d-c118-4ba6-b340-ea570746290f req-2a34f48a-ce41-46ed-9e27-7f94702c1c0b service nova] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connector [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Factory for ISCSI on None {{(pid=73091) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlnmbwqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:22 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[309c8090-b9bb-414f-a7e4-5a81da6d5e0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[405521f9-c689-4cb4-8369-ce9a4ccbc176]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca] added
Aug 16 15:02:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07338b46-2795-4486-b821-ada77f7f760d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b37eced-4568-463e-8aca-f012b65df4a3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlnmbwqy {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlnmbwqy" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[86619a1d-fc4f-45d3-8594-c62e05106191]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlnmbwqy'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e6030-35bd-4136-ad28-81e34c65efb3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a44c38-bc61-406b-b820-bf7ceea334e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:02:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:02:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:02:22 user nova-compute[73091]: 
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2439bb59-5147-4ca4-9799-07c1c354acde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260]
Aug 16 15:02:22 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa479e70-f8be-4ce1-ba89-22ee02f3a2c3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7851257d-3378-4bec-aff9-fd26dd51e19b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca (non-flash)
Aug 16 15:02:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca (non-flash)
Aug 16 15:02:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ccf7d2-ec4d-476e-9e86-ff980ff5e741]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlnmbwqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23363343739306237', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363343739306237', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lazy-loading 'flavor' on Instance uuid e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:02:23 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:23 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:02:23 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:02:23 user nova-compute[73091]:   <serial>bdf31c24-1811-429b-8f34-61bb8ef4a3ca</serial>
Aug 16 15:02:23 user nova-compute[73091]: </disk>
Aug 16 15:02:23 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] No VIF found with MAC fa:16:3e:52:0b:bf, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b00df8c8-c400-4fd9-aebc-d4a7c4d155f4 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.730s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:24 user nova-compute[73091]: INFO nova.compute.manager [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Terminating instance
Aug 16 15:02:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-9217e204-b752-4f6a-b18a-ff5e76b97576 req-c9d8998e-e676-486a-8e59-8d0294c156fa service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-vif-unplugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9217e204-b752-4f6a-b18a-ff5e76b97576 req-c9d8998e-e676-486a-8e59-8d0294c156fa service nova] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9217e204-b752-4f6a-b18a-ff5e76b97576 req-c9d8998e-e676-486a-8e59-8d0294c156fa service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9217e204-b752-4f6a-b18a-ff5e76b97576 req-c9d8998e-e676-486a-8e59-8d0294c156fa service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-9217e204-b752-4f6a-b18a-ff5e76b97576 req-c9d8998e-e676-486a-8e59-8d0294c156fa service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] No waiting events found dispatching network-vif-unplugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-9217e204-b752-4f6a-b18a-ff5e76b97576 req-c9d8998e-e676-486a-8e59-8d0294c156fa service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-vif-unplugged-792889e7-92aa-4b94-90a9-1927fa731c2a for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:02:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Instance destroyed successfully.
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lazy-loading 'resources' on Instance uuid e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-319316043',display_name='tempest-DeleteServersTestJSON-server-319316043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-319316043',id=4,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a38cf70d24848258e7c2baa433b8dc8',ramdisk_id='',reservation_id='r-115eb66t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-592121302',owner_user_name='tempest-DeleteServersTestJSON-592121302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:00:35Z,user_data=None,user_id='1586b025ccec4a1a9d6912b596a1f432',uuid=e7892ea7-3d6a-4172-bc89-26fd00b7f3d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Converting VIF {"id": "792889e7-92aa-4b94-90a9-1927fa731c2a", "address": "fa:16:3e:52:0b:bf", "network": {"id": "c9f7d27a-1785-45c4-86fe-7a6fd5a54a39", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-417653544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a38cf70d24848258e7c2baa433b8dc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap792889e7-92", "ovs_interfaceid": "792889e7-92aa-4b94-90a9-1927fa731c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_vif [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap792889e7-92, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:25 user nova-compute[73091]: INFO os_vif [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:0b:bf,bridge_name='br-int',has_traffic_filtering=True,id=792889e7-92aa-4b94-90a9-1927fa731c2a,network=Network(c9f7d27a-1785-45c4-86fe-7a6fd5a54a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap792889e7-92')
Aug 16 15:02:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlnmbwqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d663fa-b61b-4109-8307-303df6540d48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[678fd983-962d-4f76-9736-5f858b03389e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca (non-flash)
Aug 16 15:02:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca (non-flash)
Aug 16 15:02:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c3a9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ecbe1-6fc4-4ff4-b908-7a7a9b63834e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4b690-1a2f-40cf-b678-2e43ced9bf49]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96d820-e8c3-4ea1-ba99-e9cd632761c8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.176s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f351e221-7cb1-418f-8b50-8a9bdbe6dcb2]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c860c94-e2b8-4465-b989-8d3caac63bfa]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd6b76-5967-4ba0-9143-fce42c4639cb]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260]
Aug 16 15:02:26 user nova-compute[73091]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf31c24-1811-429b-8f34-61bb8ef4a3ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f8f04-e1a3-4dd0-bbf0-a3be388e441f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] <== disconnect_volume: return (414ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:02:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Deleting instance files /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2_del
Aug 16 15:02:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Deletion of /opt/stack/data/nova/instances/e7892ea7-3d6a-4172-bc89-26fd00b7f3d2_del complete
Aug 16 15:02:26 user nova-compute[73091]: INFO nova.compute.manager [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 16 15:02:26 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:02:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:27 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Took 0.72 seconds to deallocate network for instance.
Aug 16 15:02:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1f47004-b247-4f3c-97f4-eaedeff18c73 req-ca6ef501-0bd7-4adb-bad9-c95c93af395b service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-vif-deleted-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-87360c90-ffc7-4c0d-b49c-3ae788c7a18b req-14d7342c-608c-4a9f-8211-4bce6d6ec51e service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received event network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87360c90-ffc7-4c0d-b49c-3ae788c7a18b req-14d7342c-608c-4a9f-8211-4bce6d6ec51e service nova] Acquiring lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87360c90-ffc7-4c0d-b49c-3ae788c7a18b req-14d7342c-608c-4a9f-8211-4bce6d6ec51e service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87360c90-ffc7-4c0d-b49c-3ae788c7a18b req-14d7342c-608c-4a9f-8211-4bce6d6ec51e service nova] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-87360c90-ffc7-4c0d-b49c-3ae788c7a18b req-14d7342c-608c-4a9f-8211-4bce6d6ec51e service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] No waiting events found dispatching network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:27 user nova-compute[73091]: WARNING nova.compute.manager [req-87360c90-ffc7-4c0d-b49c-3ae788c7a18b req-14d7342c-608c-4a9f-8211-4bce6d6ec51e service nova] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Received unexpected event network-vif-plugged-792889e7-92aa-4b94-90a9-1927fa731c2a for instance with vm_state active and task_state deleting.
Aug 16 15:02:28 user nova-compute[73091]: INFO nova.compute.manager [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Took 1.12 seconds to detach 1 volumes for instance.
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Booting with volume 6ad65ccf-f618-4529-b08d-b739aa158e5f at /dev/vdc
Aug 16 15:02:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9114fa-96f6-4c9b-86d9-bf93807cdcb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef438c77-4a94-499a-91bd-414dcb9a0f9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53ccde7-9088-4f9c-951f-596a39dc1f4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f520a5-f3da-4eea-b51a-c8b806ce64ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:28 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc566e-5df1-4f6f-868f-13ac92e7bdfd]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating existing volume attachment record: 31b8a8b2-a212-48f2-9ccd-b8de9bb63b28 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:28 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Deleted allocations for instance e7892ea7-3d6a-4172-bc89-26fd00b7f3d2
Aug 16 15:02:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-changed-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Refreshing instance network info cache due to event network-changed-e87df0c7-59e8-41ec-a8dc-93023a482c94. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] Acquiring lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] Acquired lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Refreshing network info cache for port e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-541e858d-6b3e-47b1-a6bc-7f7811e6ff55 tempest-DeleteServersTestJSON-592121302 tempest-DeleteServersTestJSON-592121302-project-member] Lock "e7892ea7-3d6a-4172-bc89-26fd00b7f3d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.090s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updated VIF entry in instance network info cache for port e87df0c7-59e8-41ec-a8dc-93023a482c94. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:02:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updating instance_info_cache with network_info: [{"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-855e1ea9-2ad1-434e-ab43-005b6f61cff0 req-321bf928-1e92-4312-b32e-950512996094 service nova] Releasing lock "refresh_cache-c1efefe8-9e86-4194-8c94-6eaafd4c22f7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lazy-loading 'flavor' on Instance uuid c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:33 user nova-compute[73091]: INFO nova.compute.manager [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Attaching volume 3e4c8087-88ab-4523-b12f-d203cd313fd8 to /dev/sdc
Aug 16 15:02:33 user nova-compute[73091]: DEBUG os_brick.utils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b29b5e-dd7c-4cb6-8afe-ed58743b3e95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f0eb53-112c-43f2-97f3-f57e64cbb49c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1be5d9-3ecf-41d4-91f5-e06ec3dabf33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e42d3d-9ae9-451d-ae49-d3fc017b69b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:34 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bad91ca-45ea-4cda-9235-48acacef3e72]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:34 user nova-compute[73091]: DEBUG os_brick.utils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:34 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updating existing volume attachment record: 43f29139-dd8a-45e0-9715-e4c28ae8ecdb {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received event network-changed-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Refreshing instance network info cache due to event network-changed-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] Acquiring lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] Acquired lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Refreshing network info cache for port 655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:02:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updated VIF entry in instance network info cache for port 655ea32b-442a-4017-b2d9-1ee7e4d2aa8f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:02:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updating instance_info_cache with network_info: [{"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb64375b-3497-4a01-bd9d-fbc8ac783289 req-cee9f5cd-83d7-47f7-aaab-6684609b96d4 service nova] Releasing lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:02:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Creating image(s)
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Ensure instance console log exists: /opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Start _get_guest_xml network_info=[{"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '9b728c53-85c1-486d-87a8-81f40d362c6f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcIQyDVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12256aeb-47ca-4171-aca5-9a957c4a7280', 'attached_at': '', 'detached_at': '', 'volume_id': '089fd372-308f-4c51-adb3-86e1e6683570', 'serial': '089fd372-308f-4c51-adb3-86e1e6683570'}, 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': '171759bf-f2e3-43e0-8c6c-bc6d23394858', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkdJFPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12256aeb-47ca-4171-aca5-9a957c4a7280', 'attached_at': '', 'detached_at': '', 'volume_id': '86e53a67-30bc-4171-b17e-7bd52f40f73f', 'serial': '86e53a67-30bc-4171-b17e-7bd52f40f73f'}, 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': '31b8a8b2-a212-48f2-9ccd-b8de9bb63b28', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKaZFHrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12256aeb-47ca-4171-aca5-9a957c4a7280', 'attached_at': '', 'detached_at': '', 'volume_id': '6ad65ccf-f618-4529-b08d-b739aa158e5f', 'serial': '6ad65ccf-f618-4529-b08d-b739aa158e5f'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:02:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcIQyDVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:39 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[568fe22d-25e6-47ea-bd0c-6c95087162ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:39 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[73225296-9374-4f50-82ed-2a41030c39a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570] added
Aug 16 15:02:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f020a1-e4e1-4370-8511-ae2d1fb0d872]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d4ce47-bb92-4d8e-851d-2d4777ca83d0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcIQyDVq {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcIQyDVq" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fc2ce-a840-4477-8f5b-fb818717834f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcIQyDVq'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5bbf14-a43b-426d-b062-96fdd75bef44]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6792b8-d023-4d05-b9bb-e2fa617a972d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:02:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:02:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:02:40 user nova-compute[73091]: 
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f467e-9c34-40ad-9490-e83f8878db0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260]
Aug 16 15:02:40 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec727b8-b6d5-4794-aa13-d4b5c08bae02]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[548fa656-603e-4a9c-bdc4-16741b82b47b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f259193-49ef-4bdc-9465-fa05e9972380]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcIQyDVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198145.5705173, e7892ea7-3d6a-4172-bc89-26fd00b7f3d2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:40 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] VM Stopped (Lifecycle Event)
Aug 16 15:02:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-212d4cf0-b670-4b61-8efc-969e7cc51397 None None] [instance: e7892ea7-3d6a-4172-bc89-26fd00b7f3d2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26564316237323037', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564316237323037', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkdJFPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:41 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc40406-3c29-4eeb-a61c-69d5dbaaafb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de927bf-7e3d-45ae-a19d-a6d9311b364a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f] added
Aug 16 15:02:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b4fe5e-59fe-4861-af1f-45dd5c9262a2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce8367-39be-494b-a616-03650da1eec3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkdJFPnU {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-changed-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Refreshing instance network info cache due to event network-changed-523fec09-8da5-4ece-9c3d-6d4423ae4d98. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] Acquiring lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] Acquired lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Refreshing network info cache for port 523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkdJFPnU" returned: 0 in 0.089s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6473e10b-6d90-472b-9755-daca72fd2071]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkdJFPnU'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.123s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4d2c9-0e90-40a1-af49-bc4931596a52]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'flavor' on Instance uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lazy-loading 'flavor' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc100f-044d-4231-8692-3ef9a169bcb1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc9f07d-6731-4c03-844d-a17fdd452060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260]
Aug 16 15:02:41 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1cafcd-ee80-4a4a-8fa7-8cbfef7db57d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5584e506-2238-42fe-b78a-63ef3f1cb7e0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:42 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:42 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.803s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508051b-f3d7-4a11-a64a-9843de3782fc]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:42 user nova-compute[73091]: INFO nova.compute.manager [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Attaching volume 74bae5b4-24c7-4eea-be65-de8e7d5dab39 to /dev/vdb
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:42 user nova-compute[73091]: INFO nova.compute.manager [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Attaching volume 80c4f274-308f-407e-8586-820774a1e5ac to /dev/vdb
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8cba94-6f5d-4a50-96a3-a7431c27ae02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64d43b-d37d-4ccc-b885-95837afae162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[104b6324-3bb0-43c4-85aa-e2088613dde2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd836e11-4f38-4dd9-b53b-4c3f932c6f7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e36a26-168a-43fb-b648-666cc657b8ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:42 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2db2d4-993b-4e2b-803e-6b6dd70cc4b2]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updating existing volume attachment record: 3952b050-6a65-418d-b27d-87be495ab4d7 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f7762d-2c7d-46e3-9971-8efb462dbba3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6f36cd-8b5d-4f55-a3a7-0de9f29eab15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb491e-ceaf-470f-8698-3ea91d38693f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updated VIF entry in instance network info cache for port 523fec09-8da5-4ece-9c3d-6d4423ae4d98. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updating instance_info_cache with network_info: [{"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-170814a1-58b8-40fd-8d27-f0927c942435 req-55fdff48-cd6d-4e9e-97eb-b1c9ab1ef7bb service nova] Releasing lock "refresh_cache-617055ab-fdaa-41ab-ac65-ebff7a233181" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:42 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4deed1-d031-4c40-b163-2b26461ef5e5]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:42 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updating existing volume attachment record: 69b6434b-ffa0-4fb9-9c84-eb15527d05b7 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-changed-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Refreshing instance network info cache due to event network-changed-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] Acquiring lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] Acquired lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Refreshing network info cache for port 97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkdJFPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.848s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== connect_volume: return (1849ms) {'type': 'block', 'scsi_wwn': '23331623431363336', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331623431363336', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKaZFHrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:43 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:43 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:43 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[625cba94-35ab-4c71-a8ed-bab1e0a1a7a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:43 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91fc99-d88d-487a-ae42-e33948b7fee6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f] added
Aug 16 15:02:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7db18c-31d1-4167-b6fa-45890278792b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afcbe3-b8e1-4ff4-a2c7-b7ed7dd226b5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKaZFHrT {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKaZFHrT" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9705c8f-fcd9-46f0-8df8-be3b0db3f7f4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKaZFHrT'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7283a07-d2b8-4a38-bde5-f24102a8f803]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf7feab-628e-4c4e-a2b5-05e8b2eb425a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:43 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:43 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff0276-077e-4644-b85c-eebc253f9300]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260]
Aug 16 15:02:43 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc647f-3056-47a1-ab70-9ce136619209]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c7bf1-cb6d-497c-8292-300447ebd05c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:43 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:43 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:43 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:43 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e5699-0eba-457f-803f-e2c5e3b8ae32]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKaZFHrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updated VIF entry in instance network info cache for port 97c80a4f-c105-435d-ae7c-e0ef30d1fb9f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updating instance_info_cache with network_info: [{"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bf4541e6-15b7-4950-9f6c-f89869c8fbcb req-882e3453-7b79-4a3d-9a04-890b3ebaa573 service nova] Releasing lock "refresh_cache-555e458d-ddd4-41a7-8d7a-b763c3090f3d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23866663739366235', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866663739366235', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lazy-loading 'pci_devices' on Instance uuid 12256aeb-47ca-4171-aca5-9a957c4a7280 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:02:44 user nova-compute[73091]:   <uuid>12256aeb-47ca-4171-aca5-9a957c4a7280</uuid>
Aug 16 15:02:44 user nova-compute[73091]:   <name>instance-0000000b</name>
Aug 16 15:02:44 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:02:44 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:02:44 user nova-compute[73091]:   <metadata>
Aug 16 15:02:44 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:02:44 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:02:44 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-36252809</nova:name>
Aug 16 15:02:44 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:02:39</nova:creationTime>
Aug 16 15:02:44 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:02:44 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:02:44 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:02:44 user nova-compute[73091]:       <nova:owner>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:user uuid="82a129984a7c4d1ba3ce32355ba457ce">tempest-TaggedBootDevicesTest_v242-1039307430-project-member</nova:user>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:project uuid="87cfbbbb30714fd99abc17e26464726a">tempest-TaggedBootDevicesTest_v242-1039307430</nova:project>
Aug 16 15:02:44 user nova-compute[73091]:       </nova:owner>
Aug 16 15:02:44 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:02:44 user nova-compute[73091]:       <nova:ports>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="a0611e7d-1429-479a-aa0e-edf596d174aa">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="2cf09406-f304-4b68-b7d7-1a90cc0f98e2">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="6a41a498-f665-45d9-987a-f4b09ecb2543">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="612c0961-a4b9-4616-bcdb-2ca50837bfd3">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="80e7b6b1-0bd7-47ae-8d10-f40842a8d447">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="40860a54-5116-4c1b-8869-30984fe99d39">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:         <nova:port uuid="7bfbe452-abe5-4e67-8274-cf4f927616d1">
Aug 16 15:02:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 15:02:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:02:44 user nova-compute[73091]:       </nova:ports>
Aug 16 15:02:44 user nova-compute[73091]:     </nova:instance>
Aug 16 15:02:44 user nova-compute[73091]:   </metadata>
Aug 16 15:02:44 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:02:44 user nova-compute[73091]:     <system>
Aug 16 15:02:44 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:02:44 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:02:44 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:02:44 user nova-compute[73091]:       <entry name="serial">12256aeb-47ca-4171-aca5-9a957c4a7280</entry>
Aug 16 15:02:44 user nova-compute[73091]:       <entry name="uuid">12256aeb-47ca-4171-aca5-9a957c4a7280</entry>
Aug 16 15:02:44 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:02:44 user nova-compute[73091]:     </system>
Aug 16 15:02:44 user nova-compute[73091]:   </sysinfo>
Aug 16 15:02:44 user nova-compute[73091]:   <os>
Aug 16 15:02:44 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:02:44 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:02:44 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:02:44 user nova-compute[73091]:   </os>
Aug 16 15:02:44 user nova-compute[73091]:   <features>
Aug 16 15:02:44 user nova-compute[73091]:     <acpi/>
Aug 16 15:02:44 user nova-compute[73091]:     <apic/>
Aug 16 15:02:44 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:02:44 user nova-compute[73091]:   </features>
Aug 16 15:02:44 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:02:44 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:02:44 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:02:44 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:02:44 user nova-compute[73091]:   </clock>
Aug 16 15:02:44 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:02:44 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:02:44 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:02:44 user nova-compute[73091]:   </cpu>
Aug 16 15:02:44 user nova-compute[73091]:   <devices>
Aug 16 15:02:44 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 15:02:44 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 15:02:44 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280/disk.config"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 16 15:02:44 user nova-compute[73091]:     </disk>
Aug 16 15:02:44 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:02:44 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:44 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <serial>089fd372-308f-4c51-adb3-86e1e6683570</serial>
Aug 16 15:02:44 user nova-compute[73091]:     </disk>
Aug 16 15:02:44 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:02:44 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:44 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <serial>86e53a67-30bc-4171-b17e-7bd52f40f73f</serial>
Aug 16 15:02:44 user nova-compute[73091]:     </disk>
Aug 16 15:02:44 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:02:44 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:44 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <serial>6ad65ccf-f618-4529-b08d-b739aa158e5f</serial>
Aug 16 15:02:44 user nova-compute[73091]:     </disk>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:d6:de:e0"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tapa0611e7d-14"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:c3:f5:d3"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tap2cf09406-f3"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:36:f6:22"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tap6a41a498-f6"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:1c:fd:3b"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tap612c0961-a4"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:a3:4d:c6"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tap80e7b6b1-0b"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:1d:7b:06"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tap40860a54-51"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:02:44 user nova-compute[73091]:       <mac address="fa:16:3e:fc:7d:40"/>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:02:44 user nova-compute[73091]:       <target dev="tap7bfbe452-ab"/>
Aug 16 15:02:44 user nova-compute[73091]:     </interface>
Aug 16 15:02:44 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:02:44 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280/console.log" append="off"/>
Aug 16 15:02:44 user nova-compute[73091]:     </serial>
Aug 16 15:02:44 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:02:44 user nova-compute[73091]:     <video>
Aug 16 15:02:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:02:44 user nova-compute[73091]:     </video>
Aug 16 15:02:44 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:02:44 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:02:44 user nova-compute[73091]:     </rng>
Aug 16 15:02:44 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:02:44 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:02:44 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:02:44 user nova-compute[73091]:     </memballoon>
Aug 16 15:02:44 user nova-compute[73091]:   </devices>
Aug 16 15:02:44 user nova-compute[73091]: </domain>
Aug 16 15:02:44 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0611e7d-14, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0611e7d-14, col_values=(('external_ids', {'iface-id': 'a0611e7d-1429-479a-aa0e-edf596d174aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:de:e0', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14')
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf09406-f3, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cf09406-f3, col_values=(('external_ids', {'iface-id': '2cf09406-f304-4b68-b7d7-1a90cc0f98e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f5:d3', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3')
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a41a498-f6, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a41a498-f6, col_values=(('external_ids', {'iface-id': '6a41a498-f665-45d9-987a-f4b09ecb2543', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f6:22', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6')
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap612c0961-a4, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap612c0961-a4, col_values=(('external_ids', {'iface-id': '612c0961-a4b9-4616-bcdb-2ca50837bfd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:fd:3b', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4')
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80e7b6b1-0b, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80e7b6b1-0b, col_values=(('external_ids', {'iface-id': '80e7b6b1-0bd7-47ae-8d10-f40842a8d447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:4d:c6', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b')
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40860a54-51, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40860a54-51, col_values=(('external_ids', {'iface-id': '40860a54-5116-4c1b-8869-30984fe99d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:7b:06', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51')
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bfbe452-ab, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bfbe452-ab, col_values=(('external_ids', {'iface-id': '7bfbe452-abe5-4e67-8274-cf4f927616d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:7d:40', 'vm-uuid': '12256aeb-47ca-4171-aca5-9a957c4a7280'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:02:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:44 user nova-compute[73091]: INFO os_vif [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab')
Aug 16 15:02:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] No VIF found with MAC fa:16:3e:d6:de:e0, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] No VIF found with MAC fa:16:3e:a3:4d:c6, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Using config drive
Aug 16 15:02:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Creating config drive at /opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280/disk.config
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9y8qmcco {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9y8qmcco" returned: 0 in 0.065s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAigMTdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:45 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:45 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:45 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[043797e3-0fe0-4f2c-91d4-06b47a4b27ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:45 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f163b6a-90f2-417c-ad7f-844450c9a6f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8] added
Aug 16 15:02:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f7c345-d051-416a-a9fc-7c9a7c531f28]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a4ba15-bf67-4c02-b7bc-0186e32218b2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wAigMTdY {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wAigMTdY" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8202a3e9-757c-427b-b63a-5869cb447fe8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wAigMTdY'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d7e91c-e5ef-4ad9-a57e-a4f749deaed5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8917f-b402-480f-bdbc-d0eced49614a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lazy-loading 'flavor' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f177fb-d020-4507-9331-d164dfb57d43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260]
Aug 16 15:02:45 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2004ba-a420-40e6-9aa4-f4ea75da4edc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb91fc1-b8ab-4f14-a8bc-3b0aa8fad7a2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:45 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aba96f-bfea-4776-84f4-595edcb68f56]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAigMTdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:46 user nova-compute[73091]: INFO nova.compute.manager [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Attaching volume 0534c0ec-9aa8-49ed-b8ac-daea634fbee4 to /dev/vdb
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa98ee3-6f55-4542-b6a0-7e4c01adf253]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba693690-d7a6-45c2-b252-5722ad2000c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa2c39-10bd-42f6-91f5-d9fd5b3076a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6709bf-4f86-4cfd-9152-256a7613a022]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:02:46 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:02:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489daca-21ef-4677-be42-1c3c2e70caa8]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updating existing volume attachment record: 45144dac-b14c-487f-8f96-45df772df61d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23938383136663533', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938383136663533', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lazy-loading 'flavor' on Instance uuid c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:02:47 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:47 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:02:47 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 16 15:02:47 user nova-compute[73091]:   <serial>3e4c8087-88ab-4523-b12f-d203cd313fd8</serial>
Aug 16 15:02:47 user nova-compute[73091]:   <address type="drive" controller="0" unit="2"/>
Aug 16 15:02:47 user nova-compute[73091]: </disk>
Aug 16 15:02:47 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-46404757-6e2c-429b-908c-5b0cd472ad1e req-dc6306c0-fb83-487c-92ca-4d02a68459ec service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46404757-6e2c-429b-908c-5b0cd472ad1e req-dc6306c0-fb83-487c-92ca-4d02a68459ec service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46404757-6e2c-429b-908c-5b0cd472ad1e req-dc6306c0-fb83-487c-92ca-4d02a68459ec service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46404757-6e2c-429b-908c-5b0cd472ad1e req-dc6306c0-fb83-487c-92ca-4d02a68459ec service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-46404757-6e2c-429b-908c-5b0cd472ad1e req-dc6306c0-fb83-487c-92ca-4d02a68459ec service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:47 user nova-compute[73091]: WARNING nova.compute.manager [req-46404757-6e2c-429b-908c-5b0cd472ad1e req-dc6306c0-fb83-487c-92ca-4d02a68459ec service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa for instance with vm_state building and task_state spawning.
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No BDM found with device name sda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] No VIF found with MAC fa:16:3e:a2:99:e8, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cf5ce7a6-5547-4105-af16-6530dfcfb7bf req-c41d1c90-19b6-448f-bcec-509ac97ec8cb service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cf5ce7a6-5547-4105-af16-6530dfcfb7bf req-c41d1c90-19b6-448f-bcec-509ac97ec8cb service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cf5ce7a6-5547-4105-af16-6530dfcfb7bf req-c41d1c90-19b6-448f-bcec-509ac97ec8cb service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cf5ce7a6-5547-4105-af16-6530dfcfb7bf req-c41d1c90-19b6-448f-bcec-509ac97ec8cb service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cf5ce7a6-5547-4105-af16-6530dfcfb7bf req-c41d1c90-19b6-448f-bcec-509ac97ec8cb service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:48 user nova-compute[73091]: WARNING nova.compute.manager [req-cf5ce7a6-5547-4105-af16-6530dfcfb7bf req-c41d1c90-19b6-448f-bcec-509ac97ec8cb service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 for instance with vm_state building and task_state spawning.
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-192ac2a9-38fb-438b-bbd9-e76714434c06 req-8631ce99-7baf-4de2-adf3-2375e6ddc8bf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-192ac2a9-38fb-438b-bbd9-e76714434c06 req-8631ce99-7baf-4de2-adf3-2375e6ddc8bf service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-192ac2a9-38fb-438b-bbd9-e76714434c06 req-8631ce99-7baf-4de2-adf3-2375e6ddc8bf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-192ac2a9-38fb-438b-bbd9-e76714434c06 req-8631ce99-7baf-4de2-adf3-2375e6ddc8bf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-192ac2a9-38fb-438b-bbd9-e76714434c06 req-8631ce99-7baf-4de2-adf3-2375e6ddc8bf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:48 user nova-compute[73091]: WARNING nova.compute.manager [req-192ac2a9-38fb-438b-bbd9-e76714434c06 req-8631ce99-7baf-4de2-adf3-2375e6ddc8bf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 for instance with vm_state building and task_state spawning.
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-75c5d1c9-70bb-41aa-acfd-437178796f19 req-c0bd0f42-0e76-422a-af3d-2924e3c26ba4 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75c5d1c9-70bb-41aa-acfd-437178796f19 req-c0bd0f42-0e76-422a-af3d-2924e3c26ba4 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75c5d1c9-70bb-41aa-acfd-437178796f19 req-c0bd0f42-0e76-422a-af3d-2924e3c26ba4 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75c5d1c9-70bb-41aa-acfd-437178796f19 req-c0bd0f42-0e76-422a-af3d-2924e3c26ba4 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-75c5d1c9-70bb-41aa-acfd-437178796f19 req-c0bd0f42-0e76-422a-af3d-2924e3c26ba4 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:49 user nova-compute[73091]: WARNING nova.compute.manager [req-75c5d1c9-70bb-41aa-acfd-437178796f19 req-c0bd0f42-0e76-422a-af3d-2924e3c26ba4 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa for instance with vm_state building and task_state spawning.
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-0d0cd118-ce55-4a9d-82db-d0d79a824c4d req-f5f4e821-6dcf-4759-9839-fbdb808383f2 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:50 user nova-compute[73091]: WARNING nova.compute.manager [req-be387279-0bc6-4cef-a3a4-679f393df0eb req-78413506-e204-4bc7-90bf-b94969ea3d0f service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 for instance with vm_state building and task_state spawning.
Aug 16 15:02:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198171.538576, 12256aeb-47ca-4171-aca5-9a957c4a7280 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] VM Resumed (Lifecycle Event)
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance spawned successfully.
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198171.5426502, 12256aeb-47ca-4171-aca5-9a957c4a7280 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] VM Started (Lifecycle Event)
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Took 11.87 seconds to spawn the instance on the hypervisor.
Aug 16 15:02:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:02:51 user nova-compute[73091]: INFO nova.compute.manager [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Took 67.82 seconds to build instance.
Aug 16 15:02:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85a004f7-0453-418f-8a0d-5caa1b3238da tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.927s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGyKJbxV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:54 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:54 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:54 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd5c9a-7c47-4434-91d4-3ef6b69a969f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:54 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9c560-486d-47f2-9a51-9962fbc98b50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39] added
Aug 16 15:02:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6a19e-5f38-4f20-b2c2-f01311e9a91d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90397ea-6154-464d-b9ed-0ded480394ed]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uGyKJbxV {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uGyKJbxV" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d0cec-a370-4d8f-ac4b-aaf8d2d8d14f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uGyKJbxV'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee10a51-f133-4161-837c-6d237469d083]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aac486-0379-4971-8175-221cf44755a5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba1962e-42ab-4443-92fa-7e5073344207]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260]
Aug 16 15:02:55 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688b099-d8e7-43d5-a35e-e2489edbc516]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d82ef-707b-41be-9f90-e49a97c81479]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50987604-9bd2-4767-ac52-acbd535e891a]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGyKJbxV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3bef0b03-22c6-413a-83d3-65d977737207 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.468s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23536353164666566', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536353164666566', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'flavor' on Instance uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:02:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:56 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:02:56 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:02:56 user nova-compute[73091]:   <serial>74bae5b4-24c7-4eea-be65-de8e7d5dab39</serial>
Aug 16 15:02:56 user nova-compute[73091]: </disk>
Aug 16 15:02:56 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:56 user nova-compute[73091]: INFO nova.compute.manager [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Detaching volume 3e4c8087-88ab-4523-b12f-d203cd313fd8
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No VIF found with MAC fa:16:3e:64:7c:2e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:02:56 user nova-compute[73091]: INFO nova.virt.block_device [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Attempting to driver detach volume 3e4c8087-88ab-4523-b12f-d203cd313fd8 from mountpoint /dev/sdc
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Attempting to detach device sdc from instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:02:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:56 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:02:56 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 16 15:02:56 user nova-compute[73091]:   <serial>3e4c8087-88ab-4523-b12f-d203cd313fd8</serial>
Aug 16 15:02:56 user nova-compute[73091]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 15:02:56 user nova-compute[73091]: </disk>
Aug 16 15:02:56 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:02:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Successfully detached device sdc from instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 from the persistent domain config.
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:02:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:02:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:56 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:02:56 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 16 15:02:56 user nova-compute[73091]:   <serial>3e4c8087-88ab-4523-b12f-d203cd313fd8</serial>
Aug 16 15:02:56 user nova-compute[73091]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 15:02:56 user nova-compute[73091]: </disk>
Aug 16 15:02:56 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0eed6138-c159-4067-8f19-b2c751582999 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.764s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198177.3682716, c1efefe8-9e86-4194-8c94-6eaafd4c22f7 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:02:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Successfully detached device sdc from instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7 from the live domain config.
Aug 16 15:02:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAigMTdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:57 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74472336-d347-4f1e-9fc5-a6b1cc7955d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23956fb1-a483-43f2-abd0-93a8f0f7895c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 (non-flash)
Aug 16 15:02:57 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c2ff910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[04204371-75f7-4f5d-afeb-88680c25097f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[04827981-722f-4333-bf21-48bd5f8f0535]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22befbff-241b-49da-9158-aa31eac4c29e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc50be35-dc03-4a14-a226-5ae8a1ffda5c]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a221cbf-a821-4d92-806e-ff82583ba38c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed91ce-49ba-4a67-a4d0-6c82bda596fe]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260]
Aug 16 15:02:57 user nova-compute[73091]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4c8087-88ab-4523-b12f-d203cd313fd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f420c1-699e-4960-a776-e13e1b0338c3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] <== disconnect_volume: return (347ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:58 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7276db-95b6-46b6-8db3-90fe42c62c0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:02:58 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553b3ed-c71c-4db2-9f9d-01e0dde70cdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac] added
Aug 16 15:02:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa31e4-3b33-4942-bbd5-8f510720b2ea]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4241a-f24c-4c8b-87d8-37b8d6eafeb5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BErvClsy {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BErvClsy" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06d0849-d4a5-41a5-94bb-d53a15bc4295]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BErvClsy'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef85bd0-777e-4aaf-a716-de431668042a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[37adc2f0-f1c8-4653-a46c-97f3973c260d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f6339-4f5a-4d1a-85a9-3abd0fad4660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]
Aug 16 15:02:58 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: INFO nova.compute.manager [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Detaching volume 74bae5b4-24c7-4eea-be65-de8e7d5dab39
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc220d6-4490-49e5-82ad-a503b93332fb]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c9f96c-cf27-491b-b000-c25f2cea21ae]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:02:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:58 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:02:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0007fe-90ec-42e9-94ef-09cc08e4ee65]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:58 user nova-compute[73091]: INFO nova.virt.block_device [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Attempting to driver detach volume 74bae5b4-24c7-4eea-be65-de8e7d5dab39 from mountpoint /dev/vdb
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Attempting to detach device vdb from instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:02:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:58 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:02:58 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:02:58 user nova-compute[73091]:   <serial>74bae5b4-24c7-4eea-be65-de8e7d5dab39</serial>
Aug 16 15:02:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:02:58 user nova-compute[73091]: </disk>
Aug 16 15:02:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:02:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Successfully detached device vdb from instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 from the persistent domain config.
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:02:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:58 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:02:58 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:02:58 user nova-compute[73091]:   <serial>74bae5b4-24c7-4eea-be65-de8e7d5dab39</serial>
Aug 16 15:02:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:02:58 user nova-compute[73091]: </disk>
Aug 16 15:02:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lazy-loading 'flavor' on Instance uuid c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-200e1e56-ed8c-4d68-8237-9bc5e5c0a6a9 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.088s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198178.881178, 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:02:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Successfully detached device vdb from instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 from the live domain config.
Aug 16 15:02:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGyKJbxV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:02:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:02:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:02:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23332666138326566', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332666138326566', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.488s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lazy-loading 'flavor' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c63310e-bdf1-4260-9b48-753ea37a8f27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:02:59 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:02:59 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:02:59 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:02:59 user nova-compute[73091]:   <serial>80c4f274-308f-407e-8586-820774a1e5ac</serial>
Aug 16 15:02:59 user nova-compute[73091]: </disk>
Aug 16 15:02:59 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efa9bf-0e29-46ee-8f5a-a664b0e6630d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:02:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 (non-flash)
Aug 16 15:02:59 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:02:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c2c09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61889a07-73c4-4814-abf2-6cd9cb143bb9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d565f-d80b-4c62-b160-d22b4750cbc4]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4874002-4897-46d4-a2bb-d5e9a62bfb70]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10ae7e-75c5-4d2b-a201-f2529cd25f4a]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: INFO nova.compute.manager [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Terminating instance
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf7308e-38f6-48d2-8936-fc25bc36c125]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23ead90-f766-486b-bc3c-a7df6a1ff836]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260]
Aug 16 15:02:59 user nova-compute[73091]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39, portal: 172.16.0.220,3260] successful.
Aug 16 15:02:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74bae5b4-24c7-4eea-be65-de8e7d5dab39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f1c75f-da9c-4935-9929-0923d08783fb]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] <== disconnect_volume: return (877ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-38553620-c381-4378-b9c4-dced94208d40 req-16b567f0-2fc0-48ac-b27f-55362ba3100b service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-vif-unplugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-38553620-c381-4378-b9c4-dced94208d40 req-16b567f0-2fc0-48ac-b27f-55362ba3100b service nova] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-38553620-c381-4378-b9c4-dced94208d40 req-16b567f0-2fc0-48ac-b27f-55362ba3100b service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-38553620-c381-4378-b9c4-dced94208d40 req-16b567f0-2fc0-48ac-b27f-55362ba3100b service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-38553620-c381-4378-b9c4-dced94208d40 req-16b567f0-2fc0-48ac-b27f-55362ba3100b service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] No waiting events found dispatching network-vif-unplugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-38553620-c381-4378-b9c4-dced94208d40 req-16b567f0-2fc0-48ac-b27f-55362ba3100b service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-vif-unplugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:02:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] No VIF found with MAC fa:16:3e:68:27:ca, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5cbd53a9-f4a3-4188-b318-9c97d90f9278 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.831s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Instance destroyed successfully.
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lazy-loading 'resources' on Instance uuid c1efefe8-9e86-4194-8c94-6eaafd4c22f7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1570765714',display_name='tempest-AttachSCSIVolumeTestJSON-server-1570765714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1570765714',id=7,image_ref='6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAklIKjapHEK7XkTlk4Y0xsDUqtKTt5ZM1cxln/eiHdtrAO1WWMWVMjVTbAxJfda3M3EKAtyJj+CW3algTFo8lm8q57OpXz5fUGcw9dUmeiNVPOVVFTvlIyZplomLxa9MA==',key_name='tempest-keypair-371430310',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c3614b459a8405da3c723520c7ed2a2',ramdisk_id='',reservation_id='r-v9cmhvat',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6bcd8e49-75a9-46f4-9c7c-7d2d5545b13a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-680640030',owner_user_name='tempest-AttachSCSIVolumeTestJSON-680640030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d70a163fb8748bd93a6d0dd391325ed',uuid=c1efefe8-9e86-4194-8c94-6eaafd4c22f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Converting VIF {"id": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "address": "fa:16:3e:a2:99:e8", "network": {"id": "90ef6890-dfeb-45d2-87c6-74186e34519f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194991450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3614b459a8405da3c723520c7ed2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87df0c7-59", "ovs_interfaceid": "e87df0c7-59e8-41ec-a8dc-93023a482c94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG os_vif [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape87df0c7-59, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:03:00 user nova-compute[73091]: INFO os_vif [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:99:e8,bridge_name='br-int',has_traffic_filtering=True,id=e87df0c7-59e8-41ec-a8dc-93023a482c94,network=Network(90ef6890-dfeb-45d2-87c6-74186e34519f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87df0c7-59')
Aug 16 15:03:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Deleting instance files /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7_del
Aug 16 15:03:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Deletion of /opt/stack/data/nova/instances/c1efefe8-9e86-4194-8c94-6eaafd4c22f7_del complete
Aug 16 15:03:00 user nova-compute[73091]: INFO nova.compute.manager [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'flavor' on Instance uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8109926b-9b18-4c01-bf90-d8f59240de42 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.639s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG os_brick.utils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58fd615-366e-4625-982b-2f3e635d5513]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad55cb4-b81f-47b0-ab7d-a2a039a0aacd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367edba-bd7b-4c4a-9c4f-0fd46b60b4da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c26c315-e68b-465a-b9bc-1c70e26ecf3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:03:01 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bcbb0e-92ca-4c25-90ee-e72773361620]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG os_brick.utils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:01 user nova-compute[73091]: INFO nova.compute.manager [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Swapping volume 80c4f274-308f-407e-8586-820774a1e5ac for 6425306e-50c6-471a-81ca-a2b672b867ba
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-d4ad5328-9934-4fbf-ab40-5a82def196a7 req-d10d9b4b-8e0e-476a-afae-223165ce3139 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d4ad5328-9934-4fbf-ab40-5a82def196a7 req-d10d9b4b-8e0e-476a-afae-223165ce3139 service nova] Acquiring lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d4ad5328-9934-4fbf-ab40-5a82def196a7 req-d10d9b4b-8e0e-476a-afae-223165ce3139 service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d4ad5328-9934-4fbf-ab40-5a82def196a7 req-d10d9b4b-8e0e-476a-afae-223165ce3139 service nova] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-d4ad5328-9934-4fbf-ab40-5a82def196a7 req-d10d9b4b-8e0e-476a-afae-223165ce3139 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] No waiting events found dispatching network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:02 user nova-compute[73091]: WARNING nova.compute.manager [req-d4ad5328-9934-4fbf-ab40-5a82def196a7 req-d10d9b4b-8e0e-476a-afae-223165ce3139 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received unexpected event network-vif-plugged-e87df0c7-59e8-41ec-a8dc-93023a482c94 for instance with vm_state active and task_state deleting.
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Took 1.57 seconds to deallocate network for instance.
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:02 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid 'c1efefe8-9e86-4194-8c94-6eaafd4c22f7' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c1efefe8-9e86-4194-8c94-6eaafd4c22f7' (instance-00000007)
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:02 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Deleted allocations for instance c1efefe8-9e86-4194-8c94-6eaafd4c22f7
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bf47fddd-a439-4f50-915d-2f6894ff2c24 tempest-AttachSCSIVolumeTestJSON-680640030 tempest-AttachSCSIVolumeTestJSON-680640030-project-member] Lock "c1efefe8-9e86-4194-8c94-6eaafd4c22f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.378s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:03:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=6813MB free_disk=25.656124114990234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 617055ab-fdaa-41ab-ac65-ebff7a233181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9abe1902-d0cf-4d99-abab-2f83fe840476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:03:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:03:04 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:03:04 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:03:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-89699f83-8fa6-4a8d-8f92-2a6c6b3734e3 req-ea434fd4-7155-4ffd-b482-ff063688a1a1 service nova] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Received event network-vif-deleted-e87df0c7-59e8-41ec-a8dc-93023a482c94 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:03:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Updating instance_info_cache with network_info: [{"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-4481eb2c-88c2-4ada-a08f-31a9c3d325cd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:03:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'depDgmJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:09 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:09 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:09 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fb1f86-79f5-4e1a-8a02-4e2261a12ff3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:03:09 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d475c-28fd-44aa-9652-4d4a0755b864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4] added
Aug 16 15:03:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4f2ca-4f7a-4d9a-be5b-2995e73d0802]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f973341c-2741-41dc-9c9d-157262452db6]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v depDgmJP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v depDgmJP" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc01475-e929-4d4e-99a4-498063b2155e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'depDgmJP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4734c-e889-48af-9a81-a86613c1abb4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2642b2-dd97-4017-a016-23f7f21d86a3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b53e59-cd05-4962-8f90-9f74c2c6f64a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260]
Aug 16 15:03:09 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b9ddb-ccf2-40b9-a1ea-fee810fef03f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[debcf5e9-e2f0-44c1-be6e-c954d1a4dfdf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 (non-flash)
Aug 16 15:03:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:09 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 (non-flash)
Aug 16 15:03:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.111s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[55524850-ec5d-40a6-a60f-ac33114d1a2c]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:03:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'depDgmJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23262623961636630', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262623961636630', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lazy-loading 'flavor' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 15:03:10 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:03:10 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:03:10 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:03:10 user nova-compute[73091]:   <serial>0534c0ec-9aa8-49ed-b8ac-daea634fbee4</serial>
Aug 16 15:03:10 user nova-compute[73091]: </disk>
Aug 16 15:03:10 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] No VIF found with MAC fa:16:3e:e3:97:cc, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7621097-b3ee-4332-8b97-e25413bf3c88 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.255s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] volume_snapshot_create: create_info: {'snapshot_id': '6c42b36d-6da7-4323-8d75-9e8546d89500', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73091) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] snap xml: <domainsnapshot>
Aug 16 15:03:11 user nova-compute[73091]:   <disks>
Aug 16 15:03:11 user nova-compute[73091]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 16 15:03:11 user nova-compute[73091]:       <source file="/dev/new_file"/>
Aug 16 15:03:11 user nova-compute[73091]:     </disk>
Aug 16 15:03:11 user nova-compute[73091]:     <disk name="vda" snapshot="no"/>
Aug 16 15:03:11 user nova-compute[73091]:   </disks>
Aug 16 15:03:11 user nova-compute[73091]: </domainsnapshot>
Aug 16 15:03:11 user nova-compute[73091]:  {{(pid=73091) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lazy-loading 'system_metadata' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     rv = execute(f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     six.reraise(c, e, tb)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     raise value
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     rv = meth(*args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     self._volume_snapshot_create(context, instance, guest,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     rv = execute(f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     six.reraise(c, e, tb)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     raise value
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     rv = meth(*args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] 
Aug 16 15:03:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-93b491d6-1a90-4f9f-8594-81a4da4ee56b tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] volume_snapshot_delete: delete_info: {'volume_id': '0534c0ec-9aa8-49ed-b8ac-daea634fbee4'} {{(pid=73091) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-93b491d6-1a90-4f9f-8594-81a4da4ee56b tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d]     if delete_info['type'] != 'qcow2':
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] KeyError: 'type'
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6c42b36d-6da7-4323-8d75-9e8546d89500 could not be found.
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6c42b36d-6da7-4323-8d75-9e8546d89500 could not be found. (HTTP 404) (Request-ID: req-fda61900-bd2c-4994-8031-e9aefa4d06a4)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6c42b36d-6da7-4323-8d75-9e8546d89500 could not be found.
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-93b491d6-1a90-4f9f-8594-81a4da4ee56b tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1c95bdfe-86a4-4549-ba1e-2a5af019dfb6)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 15:03:11 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-c0a6fdf6-a3dd-400d-a4a1-97407b843b04 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-93b491d6-1a90-4f9f-8594-81a4da4ee56b tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 15:03:11 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 16 15:03:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Detaching volume 0534c0ec-9aa8-49ed-b8ac-daea634fbee4
Aug 16 15:03:12 user nova-compute[73091]: INFO nova.virt.block_device [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Attempting to driver detach volume 0534c0ec-9aa8-49ed-b8ac-daea634fbee4 from mountpoint /dev/vdb
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Attempting to detach device vdb from instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 15:03:12 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:03:12 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:03:12 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:03:12 user nova-compute[73091]:   <serial>0534c0ec-9aa8-49ed-b8ac-daea634fbee4</serial>
Aug 16 15:03:12 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:03:12 user nova-compute[73091]: </disk>
Aug 16 15:03:12 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:03:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Successfully detached device vdb from instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d from the persistent domain config.
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 15:03:12 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:03:12 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:03:12 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:03:12 user nova-compute[73091]:   <serial>0534c0ec-9aa8-49ed-b8ac-daea634fbee4</serial>
Aug 16 15:03:12 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:03:12 user nova-compute[73091]: </disk>
Aug 16 15:03:12 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198192.859037, 555e458d-ddd4-41a7-8d7a-b763c3090f3d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:03:12 user nova-compute[73091]: INFO nova.compute.claims [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Claim successful on node user
Aug 16 15:03:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Successfully detached device vdb from instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d from the live domain config.
Aug 16 15:03:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'depDgmJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6299b9d-9f51-4f33-8e77-f07f9234c9f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2875d-7a54-4d78-bff1-a3c8869dddaa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 (non-flash)
Aug 16 15:03:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:12 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 (non-flash)
Aug 16 15:03:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c527be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[139e408c-7dd1-4b2d-a7dc-86050032cee1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f07f2d4-1a22-4e65-a9a4-3f767572f481]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:03:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9030475d-0589-4ca1-81c6-17734393fcfd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c856be1-06b0-45f0-8467-ba68df12b6aa]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c24f022-8776-4ff8-89c5-27c60c1406c3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c918cb-296b-4660-9632-96424ba831bd]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260]
Aug 16 15:03:13 user nova-compute[73091]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c0ec-9aa8-49ed-b8ac-daea634fbee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0390c-3c0c-468e-a900-372f1e331dcc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] <== disconnect_volume: return (384ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:03:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:03:13 user nova-compute[73091]: INFO nova.virt.block_device [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Booting with blank volume at /dev/vda
Aug 16 15:03:13 user nova-compute[73091]: DEBUG nova.policy [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0243ed66e484f6a820421b1f69ece02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4d07f3079144a59f93086e00017115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lazy-loading 'flavor' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f58e8f69-1990-4ca2-a12b-78a205324df0 tempest-VolumesAssistedSnapshotsTest-1252545752 tempest-VolumesAssistedSnapshotsTest-1252545752-project-admin] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.263s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCvxeOul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '617055ab-fdaa-41ab-ac65-ebff7a233181', 'attached_at': '', 'detached_at': '', 'volume_id': '6425306e-50c6-471a-81ca-a2b672b867ba', 'serial': '6425306e-50c6-471a-81ca-a2b672b867ba'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '617055ab-fdaa-41ab-ac65-ebff7a233181', 'attached_at': '', 'detached_at': '', 'volume_id': '80c4f274-308f-407e-8586-820774a1e5ac', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCvxeOul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:14 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:14 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:14 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8350e0-400d-4a31-b646-218ed0ce385a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:03:14 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc47375-7a72-4655-9241-de7de5d8a739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba] added
Aug 16 15:03:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42db3f5-45fe-4e7c-9eed-e7830784d600]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Successfully created port: 18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae233f54-93fe-4d7f-82aa-9f5e8e2d87e4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pCvxeOul {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pCvxeOul" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd34e20-4ae8-4a83-860c-1f9458d592a9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pCvxeOul'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd27edd-76a4-4f06-ac51-068845818ba2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f8248c-8377-428b-82fb-b80a4d771c00]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:14 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:14 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:14 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:14 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:14 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:14 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f13a24-9177-444a-83a1-0b648ce6099d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260]
Aug 16 15:03:15 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d0680f-0bab-41a5-be5f-31e473ceab0a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bcd6b0-5e37-46ec-ac31-9d64ad022412]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:15 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95fe9a6-734d-470f-9d3f-0ffee166706b]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198180.4465888, c1efefe8-9e86-4194-8c94-6eaafd4c22f7 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:03:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] VM Stopped (Lifecycle Event)
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-817854b3-83bc-40b7-8304-f2df0fd525f6 None None] [instance: c1efefe8-9e86-4194-8c94-6eaafd4c22f7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Successfully updated port: 18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-changed-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Refreshing instance network info cache due to event network-changed-18c20df6-0c75-4bbf-b421-3d248a2e0d38. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] Acquiring lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:03:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance network_info: |[{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] Acquired lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Refreshing network info cache for port 18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCvxeOul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23035616532613037', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035616532613037', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lazy-loading 'flavor' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updated VIF entry in instance network info cache for port 18c20df6-0c75-4bbf-b421-3d248a2e0d38. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6643cd99-8bfe-49e4-b318-4073c6e43a5f req-04bbd959-5737-44e7-95b7-43aa9b60bdbc service nova] Releasing lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:03:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 128974848 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 617611264 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 709885952 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 886046720 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c9a09-bbc4-473b-ad5a-1dce5cf6a176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25f24d-530e-4c95-ae31-a1420eb4d546]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:20 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11541477f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9075ee35-cacf-4511-8b95-579b4e1f01bd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6031f0-dec8-45ce-a75f-7b61e6c395e9]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27c982-0cdd-40de-822b-387983a01a4f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[465f7ebe-5cda-447c-94d2-4272a0239168]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0302989a-450a-41a2-99a3-bba3c6a1eb8a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08bff8-76fd-4858-83fe-a85eded3cfdb]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]
Aug 16 15:03:20 user nova-compute[73091]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9563fb-d7bf-4220-9a0e-4d7466795dbb]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] <== disconnect_volume: return (295ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCvxeOul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '617055ab-fdaa-41ab-ac65-ebff7a233181', 'attached_at': '', 'detached_at': '', 'volume_id': '6425306e-50c6-471a-81ca-a2b672b867ba', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 15:03:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] swap_volume: removing Cinder connection for volume 80c4f274-308f-407e-8586-820774a1e5ac {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 15:03:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] swap_volume: Updating volume 80c4f274-308f-407e-8586-820774a1e5ac BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "pCvxeOul", "auth_password": "ZviE0wJaRn1Mqx", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "6425306e-50c6-471a-81ca-a2b672b867ba"}, "status": "reserved", "instance": "617055ab-fdaa-41ab-ac65-ebff7a233181", "attached_at": "", "detached_at": "", "volume_id": "6425306e-50c6-471a-81ca-a2b672b867ba", "serial": "6425306e-50c6-471a-81ca-a2b672b867ba"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6425306e-50c6-471a-81ca-a2b672b867ba', 'no_device': None, 'attachment_id': '7f75f156-015f-4f19-b438-c3fc4b369d8a'} {{(pid=73091) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 15:03:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a274339e-bb25-4517-93a6-1b3bbef30034 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.898s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c2c30-4d10-4638-902f-c9ae6b623aea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d94b2c-d892-479d-b958-9355a6f3a17c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00345ed-5b98-4823-981a-b4723b12e331]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dea56e-c19f-4970-bb47-23a01fd3ec40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:03:22 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:03:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e63862-b953-4d5e-8d53-eb1fda8404bb]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:03:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:22 user nova-compute[73091]: INFO nova.compute.manager [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Swapping volume 6425306e-50c6-471a-81ca-a2b672b867ba for 80c4f274-308f-407e-8586-820774a1e5ac
Aug 16 15:03:24 user nova-compute[73091]: DEBUG os_brick.utils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2354f-69c3-4193-92bc-707fd84c9b3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087404e-7ca9-4f55-a13f-3f634944ee87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[da29996a-9817-445c-a13f-f46486199314]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b2677-891e-4393-bcf4-72174942a986]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:03:24 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:03:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb150bc-5006-485f-a8df-8a1a7b57f349]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG os_brick.utils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:24 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating existing volume attachment record: ae2dd12d-99ac-4ffb-9468-eb5cbf6766ea {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:03:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '617055ab-fdaa-41ab-ac65-ebff7a233181', 'attached_at': '', 'detached_at': '', 'volume_id': '80c4f274-308f-407e-8586-820774a1e5ac', 'serial': '80c4f274-308f-407e-8586-820774a1e5ac'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCvxeOul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6425306e-50c6-471a-81ca-a2b672b867ba'}, 'status': 'reserved', 'instance': '617055ab-fdaa-41ab-ac65-ebff7a233181', 'attached_at': '', 'detached_at': '', 'volume_id': '6425306e-50c6-471a-81ca-a2b672b867ba', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:34 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66c3b8-7561-4099-9b07-b75941d0c5f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:03:34 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe5d10e-8924-4e2b-96ca-67adf626ab4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac] added
Aug 16 15:03:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74a1cf9-2c2a-4da5-bb90-ac10381995df]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f997ef-f81f-4212-825f-a99eeb5a3893]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BErvClsy {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BErvClsy" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[491fd80e-7c18-44d4-bcbb-872993561d83]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BErvClsy'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[49acb31a-31b8-4d60-bcd8-fde6a6ce0cfd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dbebb1-5961-4f9a-962b-5f86707698c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e90e00a-56fe-4960-878f-6cfe045a1baa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]
Aug 16 15:03:34 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c5a0d-b965-40b1-832d-3664279d76f9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1617d2-0fdd-4bfb-9514-f6d63a016a36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d27d19-2bec-4414-b912-e7423db82019]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:03:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:03:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23332666138326566', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332666138326566', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:03:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lazy-loading 'flavor' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 58720256 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:03:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Creating image(s)
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Ensure instance console log exists: /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Start _get_guest_xml network_info=[{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ae2dd12d-99ac-4ffb-9468-eb5cbf6766ea', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232', 'attached_at': '', 'detached_at': '', 'volume_id': '8a07ad26-a7e6-4d33-85dc-eae180effd2b', 'serial': '8a07ad26-a7e6-4d33-85dc-eae180effd2b'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:03:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:03:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:37 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:37 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:37 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260" returned: 21 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c55ed9-e1b9-490e-87d3-70ec48113810]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:03:37 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a07f3-2d95-467f-9f2c-8d0d937dca29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b] added
Aug 16 15:03:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e641700b-a9af-449b-ba1f-6661434c1733]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d611ff-1e81-4dc0-b5ef-c1d246a99a05]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdJYDqCG {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdJYDqCG" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[def00ad9-dffb-41de-96f6-d43eb86cb30c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdJYDqCG'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb7324f-adad-4396-80c7-68c128aea5f2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 186646528 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22fd435-50de-412d-b8cf-e50296139b5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf72c325-95a1-4161-afce-995988c0c465]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260]
Aug 16 15:03:37 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68730fe6-bf1e-4232-b084-9705ba3e930c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deb3255-bc06-42ca-9ef9-881bd0cb2781]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca31bc3-fb28-4eed-850c-b21d5e028dea]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:03:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 359661568 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 509607936 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '23931653364336162', 'path': '/dev/sdg'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653364336162', 'path': '/dev/sdg'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777760291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777760291',id=13,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-glbmaeaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:03:14Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'pci_devices' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:03:38 user nova-compute[73091]:   <uuid>dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232</uuid>
Aug 16 15:03:38 user nova-compute[73091]:   <name>instance-0000000d</name>
Aug 16 15:03:38 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:03:38 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:03:38 user nova-compute[73091]:   <metadata>
Aug 16 15:03:38 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:03:38 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:03:38 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1777760291</nova:name>
Aug 16 15:03:38 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:03:37</nova:creationTime>
Aug 16 15:03:38 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:03:38 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:03:38 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:03:38 user nova-compute[73091]:       <nova:owner>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:user uuid="c0243ed66e484f6a820421b1f69ece02">tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member</nova:user>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:project uuid="7c4d07f3079144a59f93086e00017115">tempest-ServerBootFromVolumeStableRescueTest-909556237</nova:project>
Aug 16 15:03:38 user nova-compute[73091]:       </nova:owner>
Aug 16 15:03:38 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:03:38 user nova-compute[73091]:       <nova:ports>
Aug 16 15:03:38 user nova-compute[73091]:         <nova:port uuid="18c20df6-0c75-4bbf-b421-3d248a2e0d38">
Aug 16 15:03:38 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 15:03:38 user nova-compute[73091]:         </nova:port>
Aug 16 15:03:38 user nova-compute[73091]:       </nova:ports>
Aug 16 15:03:38 user nova-compute[73091]:     </nova:instance>
Aug 16 15:03:38 user nova-compute[73091]:   </metadata>
Aug 16 15:03:38 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:03:38 user nova-compute[73091]:     <system>
Aug 16 15:03:38 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:03:38 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:03:38 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:03:38 user nova-compute[73091]:       <entry name="serial">dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232</entry>
Aug 16 15:03:38 user nova-compute[73091]:       <entry name="uuid">dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232</entry>
Aug 16 15:03:38 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:03:38 user nova-compute[73091]:     </system>
Aug 16 15:03:38 user nova-compute[73091]:   </sysinfo>
Aug 16 15:03:38 user nova-compute[73091]:   <os>
Aug 16 15:03:38 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:03:38 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:03:38 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:03:38 user nova-compute[73091]:   </os>
Aug 16 15:03:38 user nova-compute[73091]:   <features>
Aug 16 15:03:38 user nova-compute[73091]:     <acpi/>
Aug 16 15:03:38 user nova-compute[73091]:     <apic/>
Aug 16 15:03:38 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:03:38 user nova-compute[73091]:   </features>
Aug 16 15:03:38 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:03:38 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:03:38 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:03:38 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:03:38 user nova-compute[73091]:   </clock>
Aug 16 15:03:38 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:03:38 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:03:38 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:03:38 user nova-compute[73091]:   </cpu>
Aug 16 15:03:38 user nova-compute[73091]:   <devices>
Aug 16 15:03:38 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:03:38 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:03:38 user nova-compute[73091]:       <source dev="/dev/sdg"/>
Aug 16 15:03:38 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:03:38 user nova-compute[73091]:       <serial>8a07ad26-a7e6-4d33-85dc-eae180effd2b</serial>
Aug 16 15:03:38 user nova-compute[73091]:     </disk>
Aug 16 15:03:38 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:03:38 user nova-compute[73091]:       <mac address="fa:16:3e:0b:54:a1"/>
Aug 16 15:03:38 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:03:38 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:03:38 user nova-compute[73091]:       <target dev="tap18c20df6-0c"/>
Aug 16 15:03:38 user nova-compute[73091]:     </interface>
Aug 16 15:03:38 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:03:38 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/console.log" append="off"/>
Aug 16 15:03:38 user nova-compute[73091]:     </serial>
Aug 16 15:03:38 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:03:38 user nova-compute[73091]:     <video>
Aug 16 15:03:38 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:03:38 user nova-compute[73091]:     </video>
Aug 16 15:03:38 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:03:38 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:03:38 user nova-compute[73091]:     </rng>
Aug 16 15:03:38 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:03:38 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:03:38 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:03:38 user nova-compute[73091]:     </memballoon>
Aug 16 15:03:38 user nova-compute[73091]:   </devices>
Aug 16 15:03:38 user nova-compute[73091]: </domain>
Aug 16 15:03:38 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777760291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777760291',id=13,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-glbmaeaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:03:14Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG os_vif [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18c20df6-0c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18c20df6-0c, col_values=(('external_ids', {'iface-id': '18c20df6-0c75-4bbf-b421-3d248a2e0d38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:54:a1', 'vm-uuid': 'dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:38 user nova-compute[73091]: INFO os_vif [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c')
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No VIF found with MAC fa:16:3e:0b:54:a1, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:03:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 772800512 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 946864128 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCvxeOul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6425306e-50c6-471a-81ca-a2b672b867ba'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fda646-30f9-44e2-af0d-67d40f68998e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea28aa47-d7e3-47e4-9198-7d704726982a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:40 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11541479a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaffe850-8b44-418a-9655-be7985146772]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa39c535-a267-4068-8f1b-6a855cf3dbd6]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:03:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525736d-a14f-47a1-8ebf-2bb5a5fc435c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c786c-866e-4c5c-9437-3bfd8084617d]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[381bea4c-ab68-46ef-80b5-cefbf10fa533]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0fe30-e328-4dc7-b13d-d975e8e174dd]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260]
Aug 16 15:03:41 user nova-compute[73091]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6425306e-50c6-471a-81ca-a2b672b867ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5830ec-d336-432f-bcfb-1e32c2119dc1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] <== disconnect_volume: return (345ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '617055ab-fdaa-41ab-ac65-ebff7a233181', 'attached_at': '', 'detached_at': '', 'volume_id': '80c4f274-308f-407e-8586-820774a1e5ac', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 15:03:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] swap_volume: removing Cinder connection for volume 6425306e-50c6-471a-81ca-a2b672b867ba {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] swap_volume: Updating volume 6425306e-50c6-471a-81ca-a2b672b867ba BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "BErvClsy", "auth_password": "D9S2VebsvQ4Fhd", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "80c4f274-308f-407e-8586-820774a1e5ac"}, "status": "reserved", "instance": "617055ab-fdaa-41ab-ac65-ebff7a233181", "attached_at": "", "detached_at": "", "volume_id": "80c4f274-308f-407e-8586-820774a1e5ac", "serial": "80c4f274-308f-407e-8586-820774a1e5ac"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '80c4f274-308f-407e-8586-820774a1e5ac', 'no_device': None, 'attachment_id': 'bcb78d3d-fa70-44c6-80da-2e99049040f3'} {{(pid=73091) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a409762-72e1-42a4-b743-79a9964cced9 tempest-TestVolumeSwap-1605195672 tempest-TestVolumeSwap-1605195672-project-admin] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.713s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198222.7317417, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Resumed (Lifecycle Event)
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance spawned successfully.
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198222.7332838, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Started (Lifecycle Event)
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 16 15:03:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:42 user nova-compute[73091]: INFO nova.compute.manager [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Took 30.10 seconds to build instance.
Aug 16 15:03:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7cabd38d-387e-4683-be98-004e17d36604 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.259s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:43 user nova-compute[73091]: INFO nova.compute.manager [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Detaching volume 80c4f274-308f-407e-8586-820774a1e5ac
Aug 16 15:03:43 user nova-compute[73091]: INFO nova.virt.block_device [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Attempting to driver detach volume 80c4f274-308f-407e-8586-820774a1e5ac from mountpoint /dev/vdb
Aug 16 15:03:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Attempting to detach device vdb from instance 617055ab-fdaa-41ab-ac65-ebff7a233181 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:03:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:03:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:03:43 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:03:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:03:43 user nova-compute[73091]:   <serial>80c4f274-308f-407e-8586-820774a1e5ac</serial>
Aug 16 15:03:43 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:03:43 user nova-compute[73091]: </disk>
Aug 16 15:03:43 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:03:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Successfully detached device vdb from instance 617055ab-fdaa-41ab-ac65-ebff7a233181 from the persistent domain config.
Aug 16 15:03:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 617055ab-fdaa-41ab-ac65-ebff7a233181 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:03:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:03:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:03:43 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:03:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:03:43 user nova-compute[73091]:   <serial>80c4f274-308f-407e-8586-820774a1e5ac</serial>
Aug 16 15:03:43 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:03:43 user nova-compute[73091]: </disk>
Aug 16 15:03:43 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198224.250156, 617055ab-fdaa-41ab-ac65-ebff7a233181 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:03:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Successfully detached device vdb from instance 617055ab-fdaa-41ab-ac65-ebff7a233181 from the live domain config.
Aug 16 15:03:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BErvClsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '80c4f274-308f-407e-8586-820774a1e5ac'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:03:44 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d881418-6d04-4e1f-b21f-b5c656add683]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9805b2-2553-42cc-aa7e-aeba59e49548]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:03:44 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:03:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115447d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb1cb87-e682-41d3-994c-cb570a09548d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff67058c-cd49-4880-9be9-353a3af06687]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[212b4b5e-5409-485d-9ca8-02b8c6ada2c2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9375ff4-8295-4cfa-976c-e47aad20c330]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3597ac-118a-4706-8851-b90bdba56d17]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d38fec-bad2-41a3-a763-6d1247e6d11e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260]
Aug 16 15:03:44 user nova-compute[73091]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac, portal: 172.16.0.220,3260] successful.
Aug 16 15:03:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80c4f274-308f-407e-8586-820774a1e5ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b86b6c-2ea4-4bb6-a0f3-c76d67f7d03b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] <== disconnect_volume: return (302ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:03:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lazy-loading 'flavor' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8f95da5a-d055-4091-ba7e-692b9f5dffa2 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.243s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-9610715f-815b-41fb-a033-f18a4ed8b85a req-d9d30948-a5bc-4ce0-be87-69c7738390a8 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9610715f-815b-41fb-a033-f18a4ed8b85a req-d9d30948-a5bc-4ce0-be87-69c7738390a8 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9610715f-815b-41fb-a033-f18a4ed8b85a req-d9d30948-a5bc-4ce0-be87-69c7738390a8 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9610715f-815b-41fb-a033-f18a4ed8b85a req-d9d30948-a5bc-4ce0-be87-69c7738390a8 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-9610715f-815b-41fb-a033-f18a4ed8b85a req-d9d30948-a5bc-4ce0-be87-69c7738390a8 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:45 user nova-compute[73091]: WARNING nova.compute.manager [req-9610715f-815b-41fb-a033-f18a4ed8b85a req-d9d30948-a5bc-4ce0-be87-69c7738390a8 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state None.
Aug 16 15:03:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-d927cf0c-7cd9-41e7-9ac6-1ef70cd4ae2f req-ab406190-e37f-4772-b47e-38cd82a1d3b3 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d927cf0c-7cd9-41e7-9ac6-1ef70cd4ae2f req-ab406190-e37f-4772-b47e-38cd82a1d3b3 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d927cf0c-7cd9-41e7-9ac6-1ef70cd4ae2f req-ab406190-e37f-4772-b47e-38cd82a1d3b3 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d927cf0c-7cd9-41e7-9ac6-1ef70cd4ae2f req-ab406190-e37f-4772-b47e-38cd82a1d3b3 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-d927cf0c-7cd9-41e7-9ac6-1ef70cd4ae2f req-ab406190-e37f-4772-b47e-38cd82a1d3b3 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:48 user nova-compute[73091]: WARNING nova.compute.manager [req-d927cf0c-7cd9-41e7-9ac6-1ef70cd4ae2f req-ab406190-e37f-4772-b47e-38cd82a1d3b3 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state None.
Aug 16 15:03:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:03:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:03:49 user nova-compute[73091]: INFO nova.compute.claims [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Claim successful on node user
Aug 16 15:03:50 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:03:50 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:03:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.926s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:03:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:03:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:03:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:03:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG nova.policy [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9782834fd235447083d0580b13d518d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944792b19ee14226b529478fbfd50dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:03:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Creating image(s)
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "/opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "/opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk 1073741824" returned: 0 in 0.082s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Successfully created port: f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Cannot resize image /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'migration_context' on Instance uuid c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Ensure instance console log exists: /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Successfully updated port: f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "refresh_cache-c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquired lock "refresh_cache-c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Received event network-changed-f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Refreshing instance network info cache due to event network-changed-f3615140-3da3-4c4d-b1d6-6a5a366a274e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] Acquiring lock "refresh_cache-c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:03:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Updating instance_info_cache with network_info: [{"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Releasing lock "refresh_cache-c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Instance network_info: |[{"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] Acquired lock "refresh_cache-c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Refreshing network info cache for port f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Start _get_guest_xml network_info=[{"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:03:53 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:03:53 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-399343472',display_name='tempest-VolumesAdminNegativeTest-server-399343472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-399343472',id=14,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944792b19ee14226b529478fbfd50dc6',ramdisk_id='',reservation_id='r-120855jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-232748453',owner_user_name='tempest-VolumesAdminNegativeTest-232748453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:03:51Z,user_data=None,user_id='9782834fd235447083d0580b13d518d1',uuid=c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converting VIF {"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'pci_devices' on Instance uuid c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:03:53 user nova-compute[73091]:   <uuid>c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de</uuid>
Aug 16 15:03:53 user nova-compute[73091]:   <name>instance-0000000e</name>
Aug 16 15:03:53 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:03:53 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:03:53 user nova-compute[73091]:   <metadata>
Aug 16 15:03:53 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:03:53 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:03:53 user nova-compute[73091]:       <nova:name>tempest-VolumesAdminNegativeTest-server-399343472</nova:name>
Aug 16 15:03:53 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:03:53</nova:creationTime>
Aug 16 15:03:53 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:03:53 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:03:53 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:03:53 user nova-compute[73091]:       <nova:owner>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:user uuid="9782834fd235447083d0580b13d518d1">tempest-VolumesAdminNegativeTest-232748453-project-member</nova:user>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:project uuid="944792b19ee14226b529478fbfd50dc6">tempest-VolumesAdminNegativeTest-232748453</nova:project>
Aug 16 15:03:53 user nova-compute[73091]:       </nova:owner>
Aug 16 15:03:53 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:03:53 user nova-compute[73091]:       <nova:ports>
Aug 16 15:03:53 user nova-compute[73091]:         <nova:port uuid="f3615140-3da3-4c4d-b1d6-6a5a366a274e">
Aug 16 15:03:53 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 15:03:53 user nova-compute[73091]:         </nova:port>
Aug 16 15:03:53 user nova-compute[73091]:       </nova:ports>
Aug 16 15:03:53 user nova-compute[73091]:     </nova:instance>
Aug 16 15:03:53 user nova-compute[73091]:   </metadata>
Aug 16 15:03:53 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:03:53 user nova-compute[73091]:     <system>
Aug 16 15:03:53 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:03:53 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:03:53 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:03:53 user nova-compute[73091]:       <entry name="serial">c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de</entry>
Aug 16 15:03:53 user nova-compute[73091]:       <entry name="uuid">c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de</entry>
Aug 16 15:03:53 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:03:53 user nova-compute[73091]:     </system>
Aug 16 15:03:53 user nova-compute[73091]:   </sysinfo>
Aug 16 15:03:53 user nova-compute[73091]:   <os>
Aug 16 15:03:53 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:03:53 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:03:53 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:03:53 user nova-compute[73091]:   </os>
Aug 16 15:03:53 user nova-compute[73091]:   <features>
Aug 16 15:03:53 user nova-compute[73091]:     <acpi/>
Aug 16 15:03:53 user nova-compute[73091]:     <apic/>
Aug 16 15:03:53 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:03:53 user nova-compute[73091]:   </features>
Aug 16 15:03:53 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:03:53 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:03:53 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:03:53 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:03:53 user nova-compute[73091]:   </clock>
Aug 16 15:03:53 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:03:53 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:03:53 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:03:53 user nova-compute[73091]:   </cpu>
Aug 16 15:03:53 user nova-compute[73091]:   <devices>
Aug 16 15:03:53 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:03:53 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:03:53 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk"/>
Aug 16 15:03:53 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:03:53 user nova-compute[73091]:     </disk>
Aug 16 15:03:53 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:03:53 user nova-compute[73091]:       <mac address="fa:16:3e:6e:7e:7c"/>
Aug 16 15:03:53 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:03:53 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:03:53 user nova-compute[73091]:       <target dev="tapf3615140-3d"/>
Aug 16 15:03:53 user nova-compute[73091]:     </interface>
Aug 16 15:03:53 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:03:53 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/console.log" append="off"/>
Aug 16 15:03:53 user nova-compute[73091]:     </serial>
Aug 16 15:03:53 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:03:53 user nova-compute[73091]:     <video>
Aug 16 15:03:53 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:03:53 user nova-compute[73091]:     </video>
Aug 16 15:03:53 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:03:53 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:03:53 user nova-compute[73091]:     </rng>
Aug 16 15:03:53 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:03:53 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:03:53 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:03:53 user nova-compute[73091]:     </memballoon>
Aug 16 15:03:53 user nova-compute[73091]:   </devices>
Aug 16 15:03:53 user nova-compute[73091]: </domain>
Aug 16 15:03:53 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-399343472',display_name='tempest-VolumesAdminNegativeTest-server-399343472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-399343472',id=14,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944792b19ee14226b529478fbfd50dc6',ramdisk_id='',reservation_id='r-120855jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-232748453',owner_user_name='tempest-VolumesAdminNegativeTest-232748453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:03:51Z,user_data=None,user_id='9782834fd235447083d0580b13d518d1',uuid=c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converting VIF {"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG os_vif [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3615140-3d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3615140-3d, col_values=(('external_ids', {'iface-id': 'f3615140-3da3-4c4d-b1d6-6a5a366a274e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:7e:7c', 'vm-uuid': 'c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:53 user nova-compute[73091]: INFO os_vif [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d')
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] No VIF found with MAC fa:16:3e:6e:7e:7c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Updated VIF entry in instance network info cache for port f3615140-3da3-4c4d-b1d6-6a5a366a274e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Updating instance_info_cache with network_info: [{"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea7cb20-8b0f-45af-98d6-01c664cb6f2f req-c73e1f44-a683-4fee-ad82-bb9a6d428e9a service nova] Releasing lock "refresh_cache-c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:03:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:55 user nova-compute[73091]: INFO nova.compute.manager [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Terminating instance
Aug 16 15:03:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-440c0324-bcb6-4346-b7db-734b342a0344 req-795d0c48-8b94-4ce6-9866-81a39f6537b4 service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Received event network-vif-plugged-f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-440c0324-bcb6-4346-b7db-734b342a0344 req-795d0c48-8b94-4ce6-9866-81a39f6537b4 service nova] Acquiring lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-440c0324-bcb6-4346-b7db-734b342a0344 req-795d0c48-8b94-4ce6-9866-81a39f6537b4 service nova] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-440c0324-bcb6-4346-b7db-734b342a0344 req-795d0c48-8b94-4ce6-9866-81a39f6537b4 service nova] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-440c0324-bcb6-4346-b7db-734b342a0344 req-795d0c48-8b94-4ce6-9866-81a39f6537b4 service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] No waiting events found dispatching network-vif-plugged-f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:55 user nova-compute[73091]: WARNING nova.compute.manager [req-440c0324-bcb6-4346-b7db-734b342a0344 req-795d0c48-8b94-4ce6-9866-81a39f6537b4 service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Received unexpected event network-vif-plugged-f3615140-3da3-4c4d-b1d6-6a5a366a274e for instance with vm_state building and task_state spawning.
Aug 16 15:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Instance destroyed successfully.
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lazy-loading 'resources' on Instance uuid 9abe1902-d0cf-4d99-abab-2f83fe840476 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1971091729',display_name='tempest-ServersNegativeTestJSON-server-1971091729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1971091729',id=12,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6131b7ede5ec41eb9441f103318fe81f',ramdisk_id='',reservation_id='r-042mo9ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-290315528',owner_user_name='tempest-ServersNegativeTestJSON-290315528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:13Z,user_data=None,user_id='058c604dd70b49f6b8fa356a81344415',uuid=9abe1902-d0cf-4d99-abab-2f83fe840476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converting VIF {"id": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "address": "fa:16:3e:e1:76:da", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b25495-8d", "ovs_interfaceid": "98b25495-8df5-42bc-b7e6-d08cf1f783dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG os_vif [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98b25495-8d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:56 user nova-compute[73091]: INFO os_vif [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:76:da,bridge_name='br-int',has_traffic_filtering=True,id=98b25495-8df5-42bc-b7e6-d08cf1f783dd,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b25495-8d')
Aug 16 15:03:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Deleting instance files /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476_del
Aug 16 15:03:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Deletion of /opt/stack/data/nova/instances/9abe1902-d0cf-4d99-abab-2f83fe840476_del complete
Aug 16 15:03:56 user nova-compute[73091]: INFO nova.compute.manager [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 16 15:03:56 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:03:56 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Took 0.64 seconds to deallocate network for instance.
Aug 16 15:03:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Received event network-vif-plugged-f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Acquiring lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] No waiting events found dispatching network-vif-plugged-f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:57 user nova-compute[73091]: WARNING nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Received unexpected event network-vif-plugged-f3615140-3da3-4c4d-b1d6-6a5a366a274e for instance with vm_state building and task_state spawning.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received event network-vif-unplugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] No waiting events found dispatching network-vif-unplugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:57 user nova-compute[73091]: WARNING nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received unexpected event network-vif-unplugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd for instance with vm_state deleted and task_state None.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received event network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Acquiring lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] No waiting events found dispatching network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:03:57 user nova-compute[73091]: WARNING nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received unexpected event network-vif-plugged-98b25495-8df5-42bc-b7e6-d08cf1f783dd for instance with vm_state deleted and task_state None.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-69dca1c2-995e-422a-b188-311a1ab5382e req-89678e14-96a2-4d33-8940-66df3c63cac7 service nova] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Received event network-vif-deleted-98b25495-8df5-42bc-b7e6-d08cf1f783dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Deleted allocations for instance 9abe1902-d0cf-4d99-abab-2f83fe840476
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198237.5103023, c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] VM Resumed (Lifecycle Event)
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Instance spawned successfully.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198237.511759, c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] VM Started (Lifecycle Event)
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0a1fe5c4-7663-4cd1-ad46-d466948d8dbd tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "9abe1902-d0cf-4d99-abab-2f83fe840476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:03:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:03:57 user nova-compute[73091]: INFO nova.compute.manager [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Took 8.04 seconds to build instance.
Aug 16 15:03:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7244bbc0-90d0-40e3-b19e-1173eca44338 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.149s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.402s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:03:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:03:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:04:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7295MB free_disk=25.72018814086914GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 617055ab-fdaa-41ab-ac65-ebff7a233181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:04:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.157s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:04:05 user nova-compute[73091]: INFO nova.compute.claims [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Claim successful on node user
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:04:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:04:05 user nova-compute[73091]: DEBUG nova.policy [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9e2d700270c444dbd589941e320cb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eecf18330f0441985585318dd8edf13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:04:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Creating image(s)
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "/opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "/opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.278s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk 1073741824" returned: 0 in 0.060s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:04:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Cannot resize image /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lazy-loading 'migration_context' on Instance uuid 6f87afe3-51c9-4a81-ac75-bbb0a555b041 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Ensure instance console log exists: /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Successfully created port: 22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Successfully updated port: 22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "refresh_cache-6f87afe3-51c9-4a81-ac75-bbb0a555b041" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquired lock "refresh_cache-6f87afe3-51c9-4a81-ac75-bbb0a555b041" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-changed-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Refreshing instance network info cache due to event network-changed-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] Acquiring lock "refresh_cache-6f87afe3-51c9-4a81-ac75-bbb0a555b041" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Updating instance_info_cache with network_info: [{"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Releasing lock "refresh_cache-6f87afe3-51c9-4a81-ac75-bbb0a555b041" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Instance network_info: |[{"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] Acquired lock "refresh_cache-6f87afe3-51c9-4a81-ac75-bbb0a555b041" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Refreshing network info cache for port 22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Start _get_guest_xml network_info=[{"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:04:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2090711129',display_name='tempest-VolumesActionsTest-instance-2090711129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2090711129',id=15,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eecf18330f0441985585318dd8edf13',ramdisk_id='',reservation_id='r-ifypi81q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1670917556',owner_user_name='tempest-VolumesActionsTest-1670917556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:06Z,user_data=None,user_id='a9e2d700270c444dbd589941e320cb00',uuid=6f87afe3-51c9-4a81-ac75-bbb0a555b041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converting VIF {"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f87afe3-51c9-4a81-ac75-bbb0a555b041 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:04:09 user nova-compute[73091]:   <uuid>6f87afe3-51c9-4a81-ac75-bbb0a555b041</uuid>
Aug 16 15:04:09 user nova-compute[73091]:   <name>instance-0000000f</name>
Aug 16 15:04:09 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:04:09 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:04:09 user nova-compute[73091]:   <metadata>
Aug 16 15:04:09 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:04:09 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:04:09 user nova-compute[73091]:       <nova:name>tempest-VolumesActionsTest-instance-2090711129</nova:name>
Aug 16 15:04:09 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:04:09</nova:creationTime>
Aug 16 15:04:09 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:04:09 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:04:09 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:04:09 user nova-compute[73091]:       <nova:owner>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:user uuid="a9e2d700270c444dbd589941e320cb00">tempest-VolumesActionsTest-1670917556-project-member</nova:user>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:project uuid="7eecf18330f0441985585318dd8edf13">tempest-VolumesActionsTest-1670917556</nova:project>
Aug 16 15:04:09 user nova-compute[73091]:       </nova:owner>
Aug 16 15:04:09 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:04:09 user nova-compute[73091]:       <nova:ports>
Aug 16 15:04:09 user nova-compute[73091]:         <nova:port uuid="22b4c8b9-d5cb-404a-bad2-89a4785f4c6d">
Aug 16 15:04:09 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 15:04:09 user nova-compute[73091]:         </nova:port>
Aug 16 15:04:09 user nova-compute[73091]:       </nova:ports>
Aug 16 15:04:09 user nova-compute[73091]:     </nova:instance>
Aug 16 15:04:09 user nova-compute[73091]:   </metadata>
Aug 16 15:04:09 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:04:09 user nova-compute[73091]:     <system>
Aug 16 15:04:09 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:04:09 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:04:09 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:04:09 user nova-compute[73091]:       <entry name="serial">6f87afe3-51c9-4a81-ac75-bbb0a555b041</entry>
Aug 16 15:04:09 user nova-compute[73091]:       <entry name="uuid">6f87afe3-51c9-4a81-ac75-bbb0a555b041</entry>
Aug 16 15:04:09 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:04:09 user nova-compute[73091]:     </system>
Aug 16 15:04:09 user nova-compute[73091]:   </sysinfo>
Aug 16 15:04:09 user nova-compute[73091]:   <os>
Aug 16 15:04:09 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:04:09 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:04:09 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:04:09 user nova-compute[73091]:   </os>
Aug 16 15:04:09 user nova-compute[73091]:   <features>
Aug 16 15:04:09 user nova-compute[73091]:     <acpi/>
Aug 16 15:04:09 user nova-compute[73091]:     <apic/>
Aug 16 15:04:09 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:04:09 user nova-compute[73091]:   </features>
Aug 16 15:04:09 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:04:09 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:04:09 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:04:09 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:04:09 user nova-compute[73091]:   </clock>
Aug 16 15:04:09 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:04:09 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:04:09 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:04:09 user nova-compute[73091]:   </cpu>
Aug 16 15:04:09 user nova-compute[73091]:   <devices>
Aug 16 15:04:09 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:04:09 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:04:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk"/>
Aug 16 15:04:09 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:04:09 user nova-compute[73091]:     </disk>
Aug 16 15:04:09 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:04:09 user nova-compute[73091]:       <mac address="fa:16:3e:a2:9f:14"/>
Aug 16 15:04:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:04:09 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:04:09 user nova-compute[73091]:       <target dev="tap22b4c8b9-d5"/>
Aug 16 15:04:09 user nova-compute[73091]:     </interface>
Aug 16 15:04:09 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:04:09 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/console.log" append="off"/>
Aug 16 15:04:09 user nova-compute[73091]:     </serial>
Aug 16 15:04:09 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:04:09 user nova-compute[73091]:     <video>
Aug 16 15:04:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:04:09 user nova-compute[73091]:     </video>
Aug 16 15:04:09 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:04:09 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:04:09 user nova-compute[73091]:     </rng>
Aug 16 15:04:09 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:04:09 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:04:09 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:04:09 user nova-compute[73091]:     </memballoon>
Aug 16 15:04:09 user nova-compute[73091]:   </devices>
Aug 16 15:04:09 user nova-compute[73091]: </domain>
Aug 16 15:04:09 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2090711129',display_name='tempest-VolumesActionsTest-instance-2090711129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2090711129',id=15,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eecf18330f0441985585318dd8edf13',ramdisk_id='',reservation_id='r-ifypi81q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1670917556',owner_user_name='tempest-VolumesActionsTest-1670917556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:06Z,user_data=None,user_id='a9e2d700270c444dbd589941e320cb00',uuid=6f87afe3-51c9-4a81-ac75-bbb0a555b041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converting VIF {"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG os_vif [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b4c8b9-d5, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22b4c8b9-d5, col_values=(('external_ids', {'iface-id': '22b4c8b9-d5cb-404a-bad2-89a4785f4c6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:9f:14', 'vm-uuid': '6f87afe3-51c9-4a81-ac75-bbb0a555b041'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:09 user nova-compute[73091]: INFO os_vif [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5')
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] No VIF found with MAC fa:16:3e:a2:9f:14, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Updated VIF entry in instance network info cache for port 22b4c8b9-d5cb-404a-bad2-89a4785f4c6d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Updating instance_info_cache with network_info: [{"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-546ab7ae-eb94-40ea-a4a1-3c3a545d251c req-0e187689-7bf0-4bc0-a777-30c8728dd9c9 service nova] Releasing lock "refresh_cache-6f87afe3-51c9-4a81-ac75-bbb0a555b041" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:10 user nova-compute[73091]: INFO nova.compute.manager [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Terminating instance
Aug 16 15:04:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-010bdaac-0d53-44d2-b15f-d19092ef30e6 req-e60ad22d-d46a-4d27-8fac-513c1f333dd3 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-vif-unplugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-010bdaac-0d53-44d2-b15f-d19092ef30e6 req-e60ad22d-d46a-4d27-8fac-513c1f333dd3 service nova] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-010bdaac-0d53-44d2-b15f-d19092ef30e6 req-e60ad22d-d46a-4d27-8fac-513c1f333dd3 service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-010bdaac-0d53-44d2-b15f-d19092ef30e6 req-e60ad22d-d46a-4d27-8fac-513c1f333dd3 service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-010bdaac-0d53-44d2-b15f-d19092ef30e6 req-e60ad22d-d46a-4d27-8fac-513c1f333dd3 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] No waiting events found dispatching network-vif-unplugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-010bdaac-0d53-44d2-b15f-d19092ef30e6 req-e60ad22d-d46a-4d27-8fac-513c1f333dd3 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-vif-unplugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:10 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198235.9894464, 9abe1902-d0cf-4d99-abab-2f83fe840476 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:10 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] VM Stopped (Lifecycle Event)
Aug 16 15:04:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-33a350d5-5fdb-493f-8ea1-35de8a29e469 None None] [instance: 9abe1902-d0cf-4d99-abab-2f83fe840476] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-13c3c23f-4497-40d9-8044-04187cb7073d req-45257726-6a8a-4156-b81c-ef8b9278b668 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13c3c23f-4497-40d9-8044-04187cb7073d req-45257726-6a8a-4156-b81c-ef8b9278b668 service nova] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13c3c23f-4497-40d9-8044-04187cb7073d req-45257726-6a8a-4156-b81c-ef8b9278b668 service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13c3c23f-4497-40d9-8044-04187cb7073d req-45257726-6a8a-4156-b81c-ef8b9278b668 service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-13c3c23f-4497-40d9-8044-04187cb7073d req-45257726-6a8a-4156-b81c-ef8b9278b668 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] No waiting events found dispatching network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:11 user nova-compute[73091]: WARNING nova.compute.manager [req-13c3c23f-4497-40d9-8044-04187cb7073d req-45257726-6a8a-4156-b81c-ef8b9278b668 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received unexpected event network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d for instance with vm_state building and task_state spawning.
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Instance destroyed successfully.
Aug 16 15:04:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lazy-loading 'resources' on Instance uuid 555e458d-ddd4-41a7-8d7a-b763c3090f3d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1499541005',display_name='tempest-VolumesAssistedSnapshotsTest-server-1499541005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1499541005',id=10,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUs1qi9YNn8GgsNz7z9LZCBSamIgMo8nTjvw10mzK/HgkFiilUEswr0/FxG8S/o3M7kCcKj8J7VqO/e/9kplPm0gfPMvDVJUTFLDOG0BKyQ/eRaMjDZ+b2zkvedW4ZVKQ==',key_name='tempest-keypair-1292302173',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c5afb4af0834ef8aa81c324976ea127',ramdisk_id='',reservation_id='r-bbm4jht0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1605885550',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1605885550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32add1019c1e41369c1b3a38e5dbf35e',uuid=555e458d-ddd4-41a7-8d7a-b763c3090f3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Converting VIF {"id": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "address": "fa:16:3e:e3:97:cc", "network": {"id": "7d9d78be-8679-4731-a398-b69f939fb545", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997356604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5afb4af0834ef8aa81c324976ea127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c80a4f-c1", "ovs_interfaceid": "97c80a4f-c105-435d-ae7c-e0ef30d1fb9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG os_vif [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97c80a4f-c1, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:12 user nova-compute[73091]: INFO os_vif [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=97c80a4f-c105-435d-ae7c-e0ef30d1fb9f,network=Network(7d9d78be-8679-4731-a398-b69f939fb545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c80a4f-c1')
Aug 16 15:04:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Deleting instance files /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d_del
Aug 16 15:04:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Deletion of /opt/stack/data/nova/instances/555e458d-ddd4-41a7-8d7a-b763c3090f3d_del complete
Aug 16 15:04:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:12 user nova-compute[73091]: INFO nova.compute.manager [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Took 1.93 seconds to destroy the instance on the hypervisor.
Aug 16 15:04:12 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:04:12 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b1e9ae2-ea86-43f3-b56d-739919077a64 req-62b26282-6cdf-48c4-9e43-921eb6ea2fa7 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b1e9ae2-ea86-43f3-b56d-739919077a64 req-62b26282-6cdf-48c4-9e43-921eb6ea2fa7 service nova] Acquiring lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b1e9ae2-ea86-43f3-b56d-739919077a64 req-62b26282-6cdf-48c4-9e43-921eb6ea2fa7 service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b1e9ae2-ea86-43f3-b56d-739919077a64 req-62b26282-6cdf-48c4-9e43-921eb6ea2fa7 service nova] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b1e9ae2-ea86-43f3-b56d-739919077a64 req-62b26282-6cdf-48c4-9e43-921eb6ea2fa7 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] No waiting events found dispatching network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:13 user nova-compute[73091]: WARNING nova.compute.manager [req-2b1e9ae2-ea86-43f3-b56d-739919077a64 req-62b26282-6cdf-48c4-9e43-921eb6ea2fa7 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received unexpected event network-vif-plugged-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f for instance with vm_state active and task_state deleting.
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:04:13 user nova-compute[73091]: INFO nova.compute.claims [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Claim successful on node user
Aug 16 15:04:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-db51ad5b-31d0-416b-ad7a-33f7235b0497 req-280a507e-a4ec-4c26-9cb3-a6907dab4d0e service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db51ad5b-31d0-416b-ad7a-33f7235b0497 req-280a507e-a4ec-4c26-9cb3-a6907dab4d0e service nova] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db51ad5b-31d0-416b-ad7a-33f7235b0497 req-280a507e-a4ec-4c26-9cb3-a6907dab4d0e service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db51ad5b-31d0-416b-ad7a-33f7235b0497 req-280a507e-a4ec-4c26-9cb3-a6907dab4d0e service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-db51ad5b-31d0-416b-ad7a-33f7235b0497 req-280a507e-a4ec-4c26-9cb3-a6907dab4d0e service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] No waiting events found dispatching network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:13 user nova-compute[73091]: WARNING nova.compute.manager [req-db51ad5b-31d0-416b-ad7a-33f7235b0497 req-280a507e-a4ec-4c26-9cb3-a6907dab4d0e service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received unexpected event network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d for instance with vm_state building and task_state spawning.
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.832s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Took 2.18 seconds to deallocate network for instance.
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.policy [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40bf98e80707482a9c43719d7a56004a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af3ee8a3c64c50a44aa98bcdd05222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Creating image(s)
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198254.686546, 6f87afe3-51c9-4a81-ac75-bbb0a555b041 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] VM Resumed (Lifecycle Event)
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Instance spawned successfully.
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198254.6951642, 6f87afe3-51c9-4a81-ac75-bbb0a555b041 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] VM Started (Lifecycle Event)
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Took 8.81 seconds to spawn the instance on the hypervisor.
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.222s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:04:14 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:04:15 user nova-compute[73091]: INFO nova.compute.manager [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Took 10.11 seconds to build instance.
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27cf9c00-ef4d-4289-984c-4a56d265521d tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.266s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk 1073741824" returned: 0 in 0.068s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.682s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:15 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Deleted allocations for instance 555e458d-ddd4-41a7-8d7a-b763c3090f3d
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.249s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2bd63a71-5fa4-4ef2-b83f-f674d60e6721 tempest-VolumesAssistedSnapshotsTest-1605885550 tempest-VolumesAssistedSnapshotsTest-1605885550-project-member] Lock "555e458d-ddd4-41a7-8d7a-b763c3090f3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.054s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Cannot resize image /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'migration_context' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Ensure instance console log exists: /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Successfully created port: 58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-0c5860f2-f306-4236-9d59-d450f508b7e1 req-1dfdbb30-0d14-43d8-9fad-0cb3ec33b3a4 service nova] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Received event network-vif-deleted-97c80a4f-c105-435d-ae7c-e0ef30d1fb9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Successfully updated port: 58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquired lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-changed-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Refreshing instance network info cache due to event network-changed-58cb3a47-39d4-400e-9cb3-05371a448fb6. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] Acquiring lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updating instance_info_cache with network_info: [{"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Releasing lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance network_info: |[{"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] Acquired lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Refreshing network info cache for port 58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Start _get_guest_xml network_info=[{"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:04:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-659850977',display_name='tempest-tempest.common.compute-instance-659850977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-659850977',id=16,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeWiWE+9Y36hTNKc+fw6eNSTabxWHKknbdUel+a8nBFzXqQa0lYg3YyUCzGRmZrHNtjHJRU5gFgxXjrrOzz7U3DFGvvdVnjDEmR5+IzaV3ICq/c9t4KSv3+veIY46b7Xw==',key_name='tempest-keypair-183354870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-w3wwu798',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8d21e8b1-c405-4d34-a582-ec36fdefe584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:04:17 user nova-compute[73091]:   <uuid>8d21e8b1-c405-4d34-a582-ec36fdefe584</uuid>
Aug 16 15:04:17 user nova-compute[73091]:   <name>instance-00000010</name>
Aug 16 15:04:17 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:04:17 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:04:17 user nova-compute[73091]:   <metadata>
Aug 16 15:04:17 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:04:17 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:04:17 user nova-compute[73091]:       <nova:name>tempest-tempest.common.compute-instance-659850977</nova:name>
Aug 16 15:04:17 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:04:17</nova:creationTime>
Aug 16 15:04:17 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:04:17 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:04:17 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:04:17 user nova-compute[73091]:       <nova:owner>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:user uuid="40bf98e80707482a9c43719d7a56004a">tempest-ServerActionsTestOtherA-305054434-project-member</nova:user>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:project uuid="99af3ee8a3c64c50a44aa98bcdd05222">tempest-ServerActionsTestOtherA-305054434</nova:project>
Aug 16 15:04:17 user nova-compute[73091]:       </nova:owner>
Aug 16 15:04:17 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:04:17 user nova-compute[73091]:       <nova:ports>
Aug 16 15:04:17 user nova-compute[73091]:         <nova:port uuid="58cb3a47-39d4-400e-9cb3-05371a448fb6">
Aug 16 15:04:17 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:04:17 user nova-compute[73091]:         </nova:port>
Aug 16 15:04:17 user nova-compute[73091]:       </nova:ports>
Aug 16 15:04:17 user nova-compute[73091]:     </nova:instance>
Aug 16 15:04:17 user nova-compute[73091]:   </metadata>
Aug 16 15:04:17 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:04:17 user nova-compute[73091]:     <system>
Aug 16 15:04:17 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:04:17 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:04:17 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:04:17 user nova-compute[73091]:       <entry name="serial">8d21e8b1-c405-4d34-a582-ec36fdefe584</entry>
Aug 16 15:04:17 user nova-compute[73091]:       <entry name="uuid">8d21e8b1-c405-4d34-a582-ec36fdefe584</entry>
Aug 16 15:04:17 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:04:17 user nova-compute[73091]:     </system>
Aug 16 15:04:17 user nova-compute[73091]:   </sysinfo>
Aug 16 15:04:17 user nova-compute[73091]:   <os>
Aug 16 15:04:17 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:04:17 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:04:17 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:04:17 user nova-compute[73091]:   </os>
Aug 16 15:04:17 user nova-compute[73091]:   <features>
Aug 16 15:04:17 user nova-compute[73091]:     <acpi/>
Aug 16 15:04:17 user nova-compute[73091]:     <apic/>
Aug 16 15:04:17 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:04:17 user nova-compute[73091]:   </features>
Aug 16 15:04:17 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:04:17 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:04:17 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:04:17 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:04:17 user nova-compute[73091]:   </clock>
Aug 16 15:04:17 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:04:17 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:04:17 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:04:17 user nova-compute[73091]:   </cpu>
Aug 16 15:04:17 user nova-compute[73091]:   <devices>
Aug 16 15:04:17 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:04:17 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:04:17 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk"/>
Aug 16 15:04:17 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:04:17 user nova-compute[73091]:     </disk>
Aug 16 15:04:17 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:04:17 user nova-compute[73091]:       <mac address="fa:16:3e:62:e8:63"/>
Aug 16 15:04:17 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:04:17 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:04:17 user nova-compute[73091]:       <target dev="tap58cb3a47-39"/>
Aug 16 15:04:17 user nova-compute[73091]:     </interface>
Aug 16 15:04:17 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:04:17 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/console.log" append="off"/>
Aug 16 15:04:17 user nova-compute[73091]:     </serial>
Aug 16 15:04:17 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:04:17 user nova-compute[73091]:     <video>
Aug 16 15:04:17 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:04:17 user nova-compute[73091]:     </video>
Aug 16 15:04:17 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:04:17 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:04:17 user nova-compute[73091]:     </rng>
Aug 16 15:04:17 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:04:17 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:04:17 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:04:17 user nova-compute[73091]:     </memballoon>
Aug 16 15:04:17 user nova-compute[73091]:   </devices>
Aug 16 15:04:17 user nova-compute[73091]: </domain>
Aug 16 15:04:17 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-659850977',display_name='tempest-tempest.common.compute-instance-659850977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-659850977',id=16,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeWiWE+9Y36hTNKc+fw6eNSTabxWHKknbdUel+a8nBFzXqQa0lYg3YyUCzGRmZrHNtjHJRU5gFgxXjrrOzz7U3DFGvvdVnjDEmR5+IzaV3ICq/c9t4KSv3+veIY46b7Xw==',key_name='tempest-keypair-183354870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-w3wwu798',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8d21e8b1-c405-4d34-a582-ec36fdefe584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG os_vif [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58cb3a47-39, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58cb3a47-39, col_values=(('external_ids', {'iface-id': '58cb3a47-39d4-400e-9cb3-05371a448fb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:e8:63', 'vm-uuid': '8d21e8b1-c405-4d34-a582-ec36fdefe584'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:17 user nova-compute[73091]: INFO os_vif [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39')
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No VIF found with MAC fa:16:3e:62:e8:63, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updated VIF entry in instance network info cache for port 58cb3a47-39d4-400e-9cb3-05371a448fb6. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updating instance_info_cache with network_info: [{"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a84607a6-5f79-4b18-8806-515db76d9259 req-52f638b1-2ff9-4e8d-96bd-de56a4c0f5d8 service nova] Releasing lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-96e57a3d-84f9-4eb3-9e39-5792d9bd2036 req-f1b1c96b-c19f-4db9-8bff-11949f042632 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96e57a3d-84f9-4eb3-9e39-5792d9bd2036 req-f1b1c96b-c19f-4db9-8bff-11949f042632 service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96e57a3d-84f9-4eb3-9e39-5792d9bd2036 req-f1b1c96b-c19f-4db9-8bff-11949f042632 service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96e57a3d-84f9-4eb3-9e39-5792d9bd2036 req-f1b1c96b-c19f-4db9-8bff-11949f042632 service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-96e57a3d-84f9-4eb3-9e39-5792d9bd2036 req-f1b1c96b-c19f-4db9-8bff-11949f042632 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:21 user nova-compute[73091]: WARNING nova.compute.manager [req-96e57a3d-84f9-4eb3-9e39-5792d9bd2036 req-f1b1c96b-c19f-4db9-8bff-11949f042632 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state building and task_state spawning.
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198261.4310758, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] VM Resumed (Lifecycle Event)
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance spawned successfully.
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198261.4367476, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] VM Started (Lifecycle Event)
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 16 15:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Took 8.23 seconds to build instance.
Aug 16 15:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-124f64d6-3a15-4f6a-842b-f59e59776082 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.435s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-beec8d43-6326-49a7-a892-ab612f0b75b5 req-5a8a3e62-a7f6-4203-9763-9fc581e6705d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-beec8d43-6326-49a7-a892-ab612f0b75b5 req-5a8a3e62-a7f6-4203-9763-9fc581e6705d service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-beec8d43-6326-49a7-a892-ab612f0b75b5 req-5a8a3e62-a7f6-4203-9763-9fc581e6705d service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-beec8d43-6326-49a7-a892-ab612f0b75b5 req-5a8a3e62-a7f6-4203-9763-9fc581e6705d service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-beec8d43-6326-49a7-a892-ab612f0b75b5 req-5a8a3e62-a7f6-4203-9763-9fc581e6705d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:23 user nova-compute[73091]: WARNING nova.compute.manager [req-beec8d43-6326-49a7-a892-ab612f0b75b5 req-5a8a3e62-a7f6-4203-9763-9fc581e6705d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state active and task_state None.
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "416d4daf-aa71-494b-a72b-c978822ca275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:04:23 user nova-compute[73091]: INFO nova.compute.claims [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Claim successful on node user
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:04:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:04:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:04:24 user nova-compute[73091]: INFO nova.virt.block_device [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Booting with volume e93b636c-81f5-4db4-99a9-deba13b52eb9 at /dev/vda
Aug 16 15:04:24 user nova-compute[73091]: DEBUG os_brick.utils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG nova.policy [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a0c10fbba48411f944c1bef52e9a246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3d3941ef45419db169d1b5ff06514c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f6d34-9968-451b-963f-73a1635185a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc18da5c-6208-49c2-a5f5-a44ddefb1479]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578711f-b4de-49cf-8ae9-1d359afd2c7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93141440-a5b4-43cb-8409-1faadcdcd178]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:04:24 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:04:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eabc7dd-144c-4761-8d09-2c90432802f3]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG os_brick.utils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating existing volume attachment record: fecf6650-879b-4f73-8e3c-03c07d0c2a4d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:04:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully created port: ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully created port: eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-changed-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing instance network info cache due to event network-changed-a0611e7d-1429-479a-aa0e-edf596d174aa. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] Acquiring lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] Acquired lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Refreshing network info cache for port a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198252.0146263, 555e458d-ddd4-41a7-8d7a-b763c3090f3d => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] VM Stopped (Lifecycle Event)
Aug 16 15:04:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc2bae6f-f0b5-4d1c-bd00-f65e3253bc80 None None] [instance: 555e458d-ddd4-41a7-8d7a-b763c3090f3d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully created port: c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updated VIF entry in instance network info cache for port a0611e7d-1429-479a-aa0e-edf596d174aa. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b3062fc-e153-4736-85f2-4c46cecf308e req-7b99209b-cc89-45b7-92e9-d5af71fc59aa service nova] Releasing lock "refresh_cache-12256aeb-47ca-4171-aca5-9a957c4a7280" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully created port: 03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully created port: fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-ad0c68ce-314a-47c2-8230-aeb2faf65634. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3004bc5b-a987-480e-9b1b-2c8f712937f8 req-7890561e-e360-4eda-8a8b-faef480b121a service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:30 user nova-compute[73091]: INFO nova.compute.manager [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Terminating instance
Aug 16 15:04:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: 47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca2cb7bd-c6c3-475b-a0ed-cfce9d0d2bb4 req-2b0a69a0-7cee-4559-94bc-2b206e9e99b8 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca2cb7bd-c6c3-475b-a0ed-cfce9d0d2bb4 req-2b0a69a0-7cee-4559-94bc-2b206e9e99b8 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca2cb7bd-c6c3-475b-a0ed-cfce9d0d2bb4 req-2b0a69a0-7cee-4559-94bc-2b206e9e99b8 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca2cb7bd-c6c3-475b-a0ed-cfce9d0d2bb4 req-2b0a69a0-7cee-4559-94bc-2b206e9e99b8 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca2cb7bd-c6c3-475b-a0ed-cfce9d0d2bb4 req-2b0a69a0-7cee-4559-94bc-2b206e9e99b8 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca2cb7bd-c6c3-475b-a0ed-cfce9d0d2bb4 req-2b0a69a0-7cee-4559-94bc-2b206e9e99b8 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-47cd5df7-ddde-4bbe-ad46-617c5ba459ac. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port 47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Instance destroyed successfully.
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lazy-loading 'resources' on Instance uuid 12256aeb-47ca-4171-aca5-9a957c4a7280 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "a0611e7d-1429-479a-aa0e-edf596d174aa", "address": "fa:16:3e:d6:de:e0", "network": {"id": "84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629122113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0611e7d-14", "ovs_interfaceid": "a0611e7d-1429-479a-aa0e-edf596d174aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0611e7d-14, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:de:e0,bridge_name='br-int',has_traffic_filtering=True,id=a0611e7d-1429-479a-aa0e-edf596d174aa,network=Network(84896ba3-540d-4c2e-a2d9-d95ad0ee0cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0611e7d-14')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf09406-f3, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f5:d3,bridge_name='br-int',has_traffic_filtering=True,id=2cf09406-f304-4b68-b7d7-1a90cc0f98e2,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2cf09406-f3')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a41a498-f6, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=6a41a498-f665-45d9-987a-f4b09ecb2543,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a41a498-f6')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap612c0961-a4, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:fd:3b,bridge_name='br-int',has_traffic_filtering=True,id=612c0961-a4b9-4616-bcdb-2ca50837bfd3,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap612c0961-a4')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80e7b6b1-0b, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4d:c6,bridge_name='br-int',has_traffic_filtering=True,id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447,network=Network(edeca175-794b-4d35-a38a-70c0c6b8691b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7b6b1-0b')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40860a54-51, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: 13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:7b:06,bridge_name='br-int',has_traffic_filtering=True,id=40860a54-5116-4c1b-8869-30984fe99d39,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40860a54-51')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-36252809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-36252809',id=11,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZJP6erltAq762CEdr1gS2B+vNYCDKfryIvYZ4JMIoVvpZNPe6N1c1htOjO0isfHfHfkwD6DaWvHH1XuzEBAYoFpl6LoBIbL12s88Xem8IJV8Q73KZxwx6drIC81C1cg==',key_name='tempest-keypair-1373004659',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cfbbbb30714fd99abc17e26464726a',ramdisk_id='',reservation_id='r-4rp2yxww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1039307430',owner_user_name='tempest-TaggedBootDevicesTest_v242-1039307430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82a129984a7c4d1ba3ce32355ba457ce',uuid=12256aeb-47ca-4171-aca5-9a957c4a7280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converting VIF {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bfbe452-ab, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:32 user nova-compute[73091]: INFO os_vif [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=7bfbe452-abe5-4e67-8274-cf4f927616d1,network=Network(dc3988d3-6ef1-411e-ba7a-b93795c17a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bfbe452-ab')
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcIQyDVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:04:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1ff3c-eb8c-4276-91b4-e20db33fdc95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82e7b8-d732-4e58-8ffd-3272390790a4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:04:32 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:04:32 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:04:32 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:04:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:04:32 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 (non-flash)
Aug 16 15:04:32 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:04:32 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:04:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c6cb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-a0611e7d-1429-479a-aa0e-edf596d174aa for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: WARNING nova.compute.manager [req-04b71fa8-eb52-4da4-9a0f-3c3c2d97519c req-48497fd0-816e-4529-9d70-2a20fe221cce service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-a0611e7d-1429-479a-aa0e-edf596d174aa for instance with vm_state active and task_state deleting.
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16035960-fd5e-4c6e-9861-4eaf39210175]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.171s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975ed7e-7e95-46a4-bb2f-2bd780e4dffa]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de686a-ef3a-4eff-bb9b-5ee530182faa]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: WARNING nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-2cf09406-f304-4b68-b7d7-1a90cc0f98e2 for instance with vm_state active and task_state deleting.
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: WARNING nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-612c0961-a4b9-4616-bcdb-2ca50837bfd3 for instance with vm_state active and task_state deleting.
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:32 user nova-compute[73091]: WARNING nova.compute.manager [req-b8c694ca-4354-4c95-8280-abf81a5ca2e4 req-e9b21872-f403-4095-8c5c-6b5d6e51c1b1 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-7bfbe452-abe5-4e67-8274-cf4f927616d1 for instance with vm_state active and task_state deleting.
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5378e4a3-d623-4b26-b123-16e8e7558b2a]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd7f03-702a-48fe-bd5d-11a589c89ec3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd89098-bc36-479d-b0dc-bba1ea65641e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260]
Aug 16 15:04:33 user nova-compute[73091]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570, portal: 172.16.0.220,3260] successful.
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089fd372-308f-4c51-adb3-86e1e6683570 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb779f56-0d7c-4b36-8161-315d4cc622f0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.528s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== disconnect_volume: return (529ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKaZFHrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:04:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-a7d3690a-6a78-402c-ab68-6b41ca374e5d req-7c070c15-9108-4242-ac05-feaa14fb9081 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a7d3690a-6a78-402c-ab68-6b41ca374e5d req-7c070c15-9108-4242-ac05-feaa14fb9081 service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a7d3690a-6a78-402c-ab68-6b41ca374e5d req-7c070c15-9108-4242-ac05-feaa14fb9081 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a7d3690a-6a78-402c-ab68-6b41ca374e5d req-7c070c15-9108-4242-ac05-feaa14fb9081 service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-a7d3690a-6a78-402c-ab68-6b41ca374e5d req-7c070c15-9108-4242-ac05-feaa14fb9081 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-a7d3690a-6a78-402c-ab68-6b41ca374e5d req-7c070c15-9108-4242-ac05-feaa14fb9081 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-6a41a498-f665-45d9-987a-f4b09ecb2543 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a84191-41d7-42cb-8898-cd5b3ea2598d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83eb394-b4e7-45f1-b1ff-66292eabd55a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:04:33 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:04:33 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:04:33 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:04:33 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f (non-flash)
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c549360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d9edf0-4c6b-4ddb-81ab-06544477e8ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff012451-8665-45bc-877d-e4d2c474aeab]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52054b71-e184-47a9-9f59-bb9b66cbe213]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76513356-a817-49b0-aabe-3b4d38bf57ee]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8ebaf-703c-4717-a8da-a83ab102bef2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a8f6ae-6393-4afa-93e7-6a57687dcae0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260]
Aug 16 15:04:33 user nova-compute[73091]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f, portal: 172.16.0.220,3260] successful.
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ad65ccf-f618-4529-b08d-b739aa158e5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e88ac4-d03d-4922-95bd-d456bdb113f7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== disconnect_volume: return (334ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkdJFPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:04:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c819a5-6eef-4683-ae24-7c683d07c3d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f33e07-3b14-4a9f-8926-09b56716ac87]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:04:33 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:04:33 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f (non-flash)
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c549360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b8f9b8-b0d5-4411-adcb-ba9b0bfe9b92]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a8744a-5c42-482c-b0d5-8d36833cd22d]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd4a9e7-27f2-44a7-8212-78a23c379798]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe3667-6799-4618-b6be-20607e034985]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e33f6-078f-448e-91b7-6db6c4f0b666]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e76e32b-430d-4717-a209-7dcc6128d4fa]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260]
Aug 16 15:04:33 user nova-compute[73091]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f, portal: 172.16.0.220,3260] successful.
Aug 16 15:04:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86e53a67-30bc-4171-b17e-7bd52f40f73f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e699d-c87d-4adf-96e4-b366d7186581]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] <== disconnect_volume: return (330ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:04:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Deleting instance files /opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280_del
Aug 16 15:04:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Deletion of /opt/stack/data/nova/instances/12256aeb-47ca-4171-aca5-9a957c4a7280_del complete
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-13d18a09-d88c-481f-beb1-4c28608731b4. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port 13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:33 user nova-compute[73091]: INFO nova.compute.manager [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Took 3.58 seconds to destroy the instance on the hypervisor.
Aug 16 15:04:33 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:04:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:34 user nova-compute[73091]: INFO nova.compute.manager [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Terminating instance
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-eb95bba2-1e51-40f4-82dd-49a50b4588ac. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2d298177-3152-44f9-810e-b927c5eb3b9f req-7d763a48-7e50-41a5-8cdc-df70dbfdec5d service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Instance destroyed successfully.
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lazy-loading 'resources' on Instance uuid 617055ab-fdaa-41ab-ac65-ebff7a233181 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1972798108',display_name='tempest-TestVolumeSwap-server-1972798108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1972798108',id=9,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM7iRVIi11lVOEOznzRfOMubEWwmShEkabWHSxBtRCucAvoPDZqIyUUjopeQzL5Y3jTG4WJ3zGwTbYBCtiH6g1UtVC8Yiy4m3cexKtZT0y0Wj3sSddm4Jh4+F5EtEsdTQ==',key_name='tempest-keypair-973685097',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90d967817fd1492ca8336336d8da7138',ramdisk_id='',reservation_id='r-ztxk8itv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1066098404',owner_user_name='tempest-TestVolumeSwap-1066098404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1349b742d295473f959c032d8399d355',uuid=617055ab-fdaa-41ab-ac65-ebff7a233181,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Converting VIF {"id": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "address": "fa:16:3e:68:27:ca", "network": {"id": "e9cc46ef-d631-4d83-8c2e-98ab8f8096b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-340156585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90d967817fd1492ca8336336d8da7138", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap523fec09-8d", "ovs_interfaceid": "523fec09-8da5-4ece-9c3d-6d4423ae4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG os_vif [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap523fec09-8d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:35 user nova-compute[73091]: WARNING nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-6a41a498-f665-45d9-987a-f4b09ecb2543 for instance with vm_state active and task_state deleting.
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:35 user nova-compute[73091]: WARNING nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 for instance with vm_state active and task_state deleting.
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-unplugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-unplugged-40860a54-5116-4c1b-8869-30984fe99d39 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Acquiring lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] No waiting events found dispatching network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:35 user nova-compute[73091]: WARNING nova.compute.manager [req-787dc22d-9414-4eca-aad5-4cf249769019 req-c6e83c78-d8ab-46f8-9c1a-3e148f2c64cf service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received unexpected event network-vif-plugged-40860a54-5116-4c1b-8869-30984fe99d39 for instance with vm_state active and task_state deleting.
Aug 16 15:04:35 user nova-compute[73091]: INFO os_vif [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:27:ca,bridge_name='br-int',has_traffic_filtering=True,id=523fec09-8da5-4ece-9c3d-6d4423ae4d98,network=Network(e9cc46ef-d631-4d83-8c2e-98ab8f8096b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523fec09-8d')
Aug 16 15:04:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Deleting instance files /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181_del
Aug 16 15:04:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Deletion of /opt/stack/data/nova/instances/617055ab-fdaa-41ab-ac65-ebff7a233181_del complete
Aug 16 15:04:35 user nova-compute[73091]: INFO nova.compute.manager [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: 03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-c5844de6-23b2-4abf-a316-535fa352bd85. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Successfully updated port: fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-03117bbc-2aec-47d2-94e3-1184350ae321. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port 03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:36 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:36 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Took 1.66 seconds to deallocate network for instance.
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b95f71f6-dcdc-4499-b3c9-1abf78ecf272 req-d1c49f9a-1388-4249-a060-6326ddd403e0 service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-vif-unplugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] No waiting events found dispatching network-vif-unplugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:37 user nova-compute[73091]: WARNING nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received unexpected event network-vif-unplugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 for instance with vm_state deleted and task_state None.
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] Acquiring lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] No waiting events found dispatching network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:37 user nova-compute[73091]: WARNING nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received unexpected event network-vif-plugged-523fec09-8da5-4ece-9c3d-6d4423ae4d98 for instance with vm_state deleted and task_state None.
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1a3c40-cd66-4a47-bbbb-2f183c894e52 req-66bf9696-07b4-4f9e-9e4a-773023fd9337 service nova] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Received event network-vif-deleted-523fec09-8da5-4ece-9c3d-6d4423ae4d98 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-42abefb5-3512-420d-a4da-ca6d5dbda66e req-80e3fa8a-8842-4514-8c8d-413914450905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-deleted-a0611e7d-1429-479a-aa0e-edf596d174aa {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:37 user nova-compute[73091]: INFO nova.compute.manager [req-42abefb5-3512-420d-a4da-ca6d5dbda66e req-80e3fa8a-8842-4514-8c8d-413914450905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Neutron deleted interface a0611e7d-1429-479a-aa0e-edf596d174aa; detaching it from the instance and deleting it from the info cache
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-42abefb5-3512-420d-a4da-ca6d5dbda66e req-80e3fa8a-8842-4514-8c8d-413914450905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "address": "fa:16:3e:fc:7d:40", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bfbe452-ab", "ovs_interfaceid": "7bfbe452-abe5-4e67-8274-cf4f927616d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-42abefb5-3512-420d-a4da-ca6d5dbda66e req-80e3fa8a-8842-4514-8c8d-413914450905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Detach interface failed, port_id=a0611e7d-1429-479a-aa0e-edf596d174aa, reason: Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:37 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Deleted allocations for instance 617055ab-fdaa-41ab-ac65-ebff7a233181
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-56b9d66f-6496-4d25-99d4-0b6b3fe9d349 tempest-TestVolumeSwap-1066098404 tempest-TestVolumeSwap-1066098404-project-member] Lock "617055ab-fdaa-41ab-ac65-ebff7a233181" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.528s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-fe301652-4ccd-4986-8597-b65c7dacf3f5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:38 user nova-compute[73091]: INFO nova.virt.block_device [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Booting with volume 8e4e0893-8a6d-4df4-bf4a-8a172d04a832 at /dev/vdb
Aug 16 15:04:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b03d3b4-347b-4fac-9493-f2be18ed8b8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7497dc2-de0b-4f2d-a807-a219d437db0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1420aa-b578-4ccd-8b64-36a3471cc6a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d83cc-3aaf-4051-9931-55186390f77a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:04:38 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:04:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e69eb-9a0b-47fc-9db9-449ca13a1ff4]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:04:38 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating existing volume attachment record: 7cdc40ce-ea29-4b1e-92b9-7622a578558e {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-deleted-7bfbe452-abe5-4e67-8274-cf4f927616d1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:39 user nova-compute[73091]: INFO nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Neutron deleted interface 7bfbe452-abe5-4e67-8274-cf4f927616d1; detaching it from the instance and deleting it from the info cache
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "address": "fa:16:3e:1c:fd:3b", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap612c0961-a4", "ovs_interfaceid": "612c0961-a4b9-4616-bcdb-2ca50837bfd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Detach interface failed, port_id=7bfbe452-abe5-4e67-8274-cf4f927616d1, reason: Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-deleted-612c0961-a4b9-4616-bcdb-2ca50837bfd3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:39 user nova-compute[73091]: INFO nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Neutron deleted interface 612c0961-a4b9-4616-bcdb-2ca50837bfd3; detaching it from the instance and deleting it from the info cache
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "address": "fa:16:3e:a3:4d:c6", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7b6b1-0b", "ovs_interfaceid": "80e7b6b1-0bd7-47ae-8d10-f40842a8d447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Detach interface failed, port_id=612c0961-a4b9-4616-bcdb-2ca50837bfd3, reason: Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-deleted-80e7b6b1-0bd7-47ae-8d10-f40842a8d447 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:39 user nova-compute[73091]: INFO nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Neutron deleted interface 80e7b6b1-0bd7-47ae-8d10-f40842a8d447; detaching it from the instance and deleting it from the info cache
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [{"id": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "address": "fa:16:3e:c3:f5:d3", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf09406-f3", "ovs_interfaceid": "2cf09406-f304-4b68-b7d7-1a90cc0f98e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a41a498-f665-45d9-987a-f4b09ecb2543", "address": "fa:16:3e:36:f6:22", "network": {"id": "edeca175-794b-4d35-a38a-70c0c6b8691b", "bridge": "br-int", "label": "tempest-device-tagging-net1-182883528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a41a498-f6", "ovs_interfaceid": "6a41a498-f665-45d9-987a-f4b09ecb2543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "40860a54-5116-4c1b-8869-30984fe99d39", "address": "fa:16:3e:1d:7b:06", "network": {"id": "dc3988d3-6ef1-411e-ba7a-b93795c17a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581212218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87cfbbbb30714fd99abc17e26464726a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40860a54-51", "ovs_interfaceid": "40860a54-5116-4c1b-8869-30984fe99d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd050222-669f-4899-80bd-ee49d2431d77 req-e80203e9-9585-4a2a-a818-be3991a89905 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Detach interface failed, port_id=80e7b6b1-0bd7-47ae-8d10-f40842a8d447, reason: Instance 12256aeb-47ca-4171-aca5-9a957c4a7280 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:04:39 user nova-compute[73091]: INFO nova.compute.claims [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Claim successful on node user
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:40 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Took 6.33 seconds to deallocate network for instance.
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance network_info: |[{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.network.neutron [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:04:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.policy [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb68f9de4034c3386d7ccb8333c6f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79780a126247e3afc48a27aed45371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:04:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Creating image(s)
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.network.neutron [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updated VIF entry in instance network info cache for port fe301652-4ccd-4986-8597-b65c7dacf3f5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG nova.network.neutron [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1a2cf0d-306d-415d-b886-bbeae85efc0a req-91f7b0c9-cd7b-4af4-8aa1-185970d32026 service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk 1073741824" returned: 0 in 0.049s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Successfully created port: 87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Cannot resize image /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'migration_context' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Ensure instance console log exists: /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-ec495ef8-e720-4792-af73-877869c52049 req-bc8eb0f1-ff92-4086-a23a-a8812122f873 service nova] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Received event network-vif-deleted-40860a54-5116-4c1b-8869-30984fe99d39 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Successfully updated port: 87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquired lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:04:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Releasing lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Instance network_info: |[{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Start _get_guest_xml network_info=[{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:04:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:04:42 user nova-compute[73091]:   <uuid>8d7711c7-b746-4965-af37-1a9b439c7435</uuid>
Aug 16 15:04:42 user nova-compute[73091]:   <name>instance-00000012</name>
Aug 16 15:04:42 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:04:42 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:04:42 user nova-compute[73091]:   <metadata>
Aug 16 15:04:42 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:04:42 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:04:42 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-1035689665</nova:name>
Aug 16 15:04:42 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:04:42</nova:creationTime>
Aug 16 15:04:42 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:04:42 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:04:42 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:04:42 user nova-compute[73091]:       <nova:owner>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:user uuid="ebb68f9de4034c3386d7ccb8333c6f45">tempest-TaggedAttachmentsTest-772280576-project-member</nova:user>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:project uuid="df79780a126247e3afc48a27aed45371">tempest-TaggedAttachmentsTest-772280576</nova:project>
Aug 16 15:04:42 user nova-compute[73091]:       </nova:owner>
Aug 16 15:04:42 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:04:42 user nova-compute[73091]:       <nova:ports>
Aug 16 15:04:42 user nova-compute[73091]:         <nova:port uuid="87877225-4724-4450-86a5-8bc5484ad81f">
Aug 16 15:04:42 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:04:42 user nova-compute[73091]:         </nova:port>
Aug 16 15:04:42 user nova-compute[73091]:       </nova:ports>
Aug 16 15:04:42 user nova-compute[73091]:     </nova:instance>
Aug 16 15:04:42 user nova-compute[73091]:   </metadata>
Aug 16 15:04:42 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:04:42 user nova-compute[73091]:     <system>
Aug 16 15:04:42 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:04:42 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:04:42 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:04:42 user nova-compute[73091]:       <entry name="serial">8d7711c7-b746-4965-af37-1a9b439c7435</entry>
Aug 16 15:04:42 user nova-compute[73091]:       <entry name="uuid">8d7711c7-b746-4965-af37-1a9b439c7435</entry>
Aug 16 15:04:42 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:04:42 user nova-compute[73091]:     </system>
Aug 16 15:04:42 user nova-compute[73091]:   </sysinfo>
Aug 16 15:04:42 user nova-compute[73091]:   <os>
Aug 16 15:04:42 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:04:42 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:04:42 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:04:42 user nova-compute[73091]:   </os>
Aug 16 15:04:42 user nova-compute[73091]:   <features>
Aug 16 15:04:42 user nova-compute[73091]:     <acpi/>
Aug 16 15:04:42 user nova-compute[73091]:     <apic/>
Aug 16 15:04:42 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:04:42 user nova-compute[73091]:   </features>
Aug 16 15:04:42 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:04:42 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:04:42 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:04:42 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:04:42 user nova-compute[73091]:   </clock>
Aug 16 15:04:42 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:04:42 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:04:42 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:04:42 user nova-compute[73091]:   </cpu>
Aug 16 15:04:42 user nova-compute[73091]:   <devices>
Aug 16 15:04:42 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:04:42 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:04:42 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk"/>
Aug 16 15:04:42 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:04:42 user nova-compute[73091]:     </disk>
Aug 16 15:04:42 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 15:04:42 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 15:04:42 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.config"/>
Aug 16 15:04:42 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 16 15:04:42 user nova-compute[73091]:     </disk>
Aug 16 15:04:42 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:04:42 user nova-compute[73091]:       <mac address="fa:16:3e:48:1b:e7"/>
Aug 16 15:04:42 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:04:42 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:04:42 user nova-compute[73091]:       <target dev="tap87877225-47"/>
Aug 16 15:04:42 user nova-compute[73091]:     </interface>
Aug 16 15:04:42 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:04:42 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/console.log" append="off"/>
Aug 16 15:04:42 user nova-compute[73091]:     </serial>
Aug 16 15:04:42 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:04:42 user nova-compute[73091]:     <video>
Aug 16 15:04:42 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:04:42 user nova-compute[73091]:     </video>
Aug 16 15:04:42 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:04:42 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:04:42 user nova-compute[73091]:     </rng>
Aug 16 15:04:42 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:04:42 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:04:42 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:04:42 user nova-compute[73091]:     </memballoon>
Aug 16 15:04:42 user nova-compute[73091]:   </devices>
Aug 16 15:04:42 user nova-compute[73091]: </domain>
Aug 16 15:04:42 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG os_vif [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87877225-47, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87877225-47, col_values=(('external_ids', {'iface-id': '87877225-4724-4450-86a5-8bc5484ad81f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:1b:e7', 'vm-uuid': '8d7711c7-b746-4965-af37-1a9b439c7435'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:42 user nova-compute[73091]: INFO os_vif [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47')
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No VIF found with MAC fa:16:3e:48:1b:e7, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:04:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Using config drive
Aug 16 15:04:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Creating config drive at /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.config
Aug 16 15:04:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppc2s1s_f {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppc2s1s_f" returned: 0 in 0.054s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-changed-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Refreshing instance network info cache due to event network-changed-87877225-4724-4450-86a5-8bc5484ad81f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] Acquiring lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] Acquired lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Refreshing network info cache for port 87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updated VIF entry in instance network info cache for port 87877225-4724-4450-86a5-8bc5484ad81f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca5a593a-70fd-403f-bfeb-e82fc618aaa7 req-ce4115e4-4f38-4d5c-99de-569344f96c8f service nova] Releasing lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bf1d80b-25d4-4a4b-b4b4-878d504e57d4 req-b291e0f1-89d3-45c8-995b-4dcbf6b362aa service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bf1d80b-25d4-4a4b-b4b4-878d504e57d4 req-b291e0f1-89d3-45c8-995b-4dcbf6b362aa service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bf1d80b-25d4-4a4b-b4b4-878d504e57d4 req-b291e0f1-89d3-45c8-995b-4dcbf6b362aa service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bf1d80b-25d4-4a4b-b4b4-878d504e57d4 req-b291e0f1-89d3-45c8-995b-4dcbf6b362aa service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bf1d80b-25d4-4a4b-b4b4-878d504e57d4 req-b291e0f1-89d3-45c8-995b-4dcbf6b362aa service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:44 user nova-compute[73091]: WARNING nova.compute.manager [req-8bf1d80b-25d4-4a4b-b4b4-878d504e57d4 req-b291e0f1-89d3-45c8-995b-4dcbf6b362aa service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f for instance with vm_state building and task_state spawning.
Aug 16 15:04:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198286.0679562, 8d7711c7-b746-4965-af37-1a9b439c7435 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] VM Resumed (Lifecycle Event)
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Instance spawned successfully.
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198286.068281, 8d7711c7-b746-4965-af37-1a9b439c7435 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] VM Started (Lifecycle Event)
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:46 user nova-compute[73091]: INFO nova.compute.manager [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Took 6.65 seconds to build instance.
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc7256ba-6764-4fa3-b196-5ca8f8b000df req-e9ef99f2-f227-4078-92ba-38405b84900b service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc7256ba-6764-4fa3-b196-5ca8f8b000df req-e9ef99f2-f227-4078-92ba-38405b84900b service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc7256ba-6764-4fa3-b196-5ca8f8b000df req-e9ef99f2-f227-4078-92ba-38405b84900b service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc7256ba-6764-4fa3-b196-5ca8f8b000df req-e9ef99f2-f227-4078-92ba-38405b84900b service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc7256ba-6764-4fa3-b196-5ca8f8b000df req-e9ef99f2-f227-4078-92ba-38405b84900b service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:04:46 user nova-compute[73091]: WARNING nova.compute.manager [req-bc7256ba-6764-4fa3-b196-5ca8f8b000df req-e9ef99f2-f227-4078-92ba-38405b84900b service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f for instance with vm_state active and task_state None.
Aug 16 15:04:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd5fda11-bdb6-49c6-8e80-d020a7664aaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.751s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:47 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198272.1111073, 12256aeb-47ca-4171-aca5-9a957c4a7280 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:47 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] VM Stopped (Lifecycle Event)
Aug 16 15:04:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eef053f9-0ef5-4f32-901a-66446b896802 None None] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198275.1354032, 617055ab-fdaa-41ab-ac65-ebff7a233181 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:04:50 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] VM Stopped (Lifecycle Event)
Aug 16 15:04:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2163a961-b290-4239-b7ca-af0fc50f4760 None None] [instance: 617055ab-fdaa-41ab-ac65-ebff7a233181] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:04:50 user nova-compute[73091]: INFO nova.virt.block_device [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Booting with volume 7ec316be-57f0-4318-9c11-b2d3ea40ff43 at /dev/vdc
Aug 16 15:04:50 user nova-compute[73091]: DEBUG os_brick.utils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1e74d-88fc-4e8c-9694-9ebf0471f482]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca4842-7e19-45d7-b5f1-157c2bf1be5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2e769-48b3-4d8c-9798-0088b130f800]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b288d1d-7433-4374-949e-a6a99469173b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:04:50 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:04:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef25c21-39c2-481d-b8c6-40cc4ee43d5d]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG os_brick.utils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:04:50 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating existing volume attachment record: 71a3d0a5-8cb1-46a7-ae79-2d09e7cac0db {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:04:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:04:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:00 user nova-compute[73091]: INFO nova.compute.manager [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Rescuing
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-58db8cc3-1cc2-4fc6-9f89-d0708e9f34e5 req-4550a504-77bf-45cd-9536-5ef81ba4531a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-58db8cc3-1cc2-4fc6-9f89-d0708e9f34e5 req-4550a504-77bf-45cd-9536-5ef81ba4531a service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-58db8cc3-1cc2-4fc6-9f89-d0708e9f34e5 req-4550a504-77bf-45cd-9536-5ef81ba4531a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-58db8cc3-1cc2-4fc6-9f89-d0708e9f34e5 req-4550a504-77bf-45cd-9536-5ef81ba4531a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-58db8cc3-1cc2-4fc6-9f89-d0708e9f34e5 req-4550a504-77bf-45cd-9536-5ef81ba4531a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:02 user nova-compute[73091]: WARNING nova.compute.manager [req-58db8cc3-1cc2-4fc6-9f89-d0708e9f34e5 req-4550a504-77bf-45cd-9536-5ef81ba4531a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state rescuing.
Aug 16 15:05:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance destroyed successfully.
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Attempting rescue
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:05:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Creating image(s)
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: INFO nova.compute.manager [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] [instance: 12256aeb-47ca-4171-aca5-9a957c4a7280] Took 22.48 seconds to detach 3 volumes for instance.
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue" returned: 0 in 0.056s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'migration_context' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Start _get_guest_xml network_info=[{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:da:30:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'resources' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'numa_topology' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:02 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:02 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-13584052',display_name='tempest-ServerRescueNegativeTestJSON-server-13584052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-13584052',id=2,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-soyz7s4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:00:36Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=9498b706-c5d2-4ba8-9d94-bc335fbdca2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:da:30:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:da:30:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'pci_devices' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:05:02 user nova-compute[73091]:   <uuid>9498b706-c5d2-4ba8-9d94-bc335fbdca2b</uuid>
Aug 16 15:05:02 user nova-compute[73091]:   <name>instance-00000002</name>
Aug 16 15:05:02 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:05:02 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:05:02 user nova-compute[73091]:   <metadata>
Aug 16 15:05:02 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:05:02 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:05:02 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-13584052</nova:name>
Aug 16 15:05:02 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:05:02</nova:creationTime>
Aug 16 15:05:02 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:05:02 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:05:02 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:05:02 user nova-compute[73091]:       <nova:owner>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:user uuid="9348c14ed1dc496ebf20d26e3b31779a">tempest-ServerRescueNegativeTestJSON-789793483-project-member</nova:user>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:project uuid="4cabeffd95264d63aa6802f8a91387e9">tempest-ServerRescueNegativeTestJSON-789793483</nova:project>
Aug 16 15:05:02 user nova-compute[73091]:       </nova:owner>
Aug 16 15:05:02 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:05:02 user nova-compute[73091]:       <nova:ports>
Aug 16 15:05:02 user nova-compute[73091]:         <nova:port uuid="0b71273e-c1f5-49dc-9eda-63f7d131828f">
Aug 16 15:05:02 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 15:05:02 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:02 user nova-compute[73091]:       </nova:ports>
Aug 16 15:05:02 user nova-compute[73091]:     </nova:instance>
Aug 16 15:05:02 user nova-compute[73091]:   </metadata>
Aug 16 15:05:02 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:05:02 user nova-compute[73091]:     <system>
Aug 16 15:05:02 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:05:02 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:05:02 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:05:02 user nova-compute[73091]:       <entry name="serial">9498b706-c5d2-4ba8-9d94-bc335fbdca2b</entry>
Aug 16 15:05:02 user nova-compute[73091]:       <entry name="uuid">9498b706-c5d2-4ba8-9d94-bc335fbdca2b</entry>
Aug 16 15:05:02 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:05:02 user nova-compute[73091]:     </system>
Aug 16 15:05:02 user nova-compute[73091]:   </sysinfo>
Aug 16 15:05:02 user nova-compute[73091]:   <os>
Aug 16 15:05:02 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:05:02 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:05:02 user nova-compute[73091]:   </os>
Aug 16 15:05:02 user nova-compute[73091]:   <features>
Aug 16 15:05:02 user nova-compute[73091]:     <acpi/>
Aug 16 15:05:02 user nova-compute[73091]:     <apic/>
Aug 16 15:05:02 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:05:02 user nova-compute[73091]:   </features>
Aug 16 15:05:02 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:05:02 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:05:02 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:05:02 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:05:02 user nova-compute[73091]:   </clock>
Aug 16 15:05:02 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:05:02 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:05:02 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:05:02 user nova-compute[73091]:   </cpu>
Aug 16 15:05:02 user nova-compute[73091]:   <devices>
Aug 16 15:05:02 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:05:02 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:05:02 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue"/>
Aug 16 15:05:02 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:05:02 user nova-compute[73091]:     </disk>
Aug 16 15:05:02 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:05:02 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:05:02 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk"/>
Aug 16 15:05:02 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:05:02 user nova-compute[73091]:     </disk>
Aug 16 15:05:02 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:02 user nova-compute[73091]:       <mac address="fa:16:3e:da:30:1a"/>
Aug 16 15:05:02 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:02 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:02 user nova-compute[73091]:       <target dev="tap0b71273e-c1"/>
Aug 16 15:05:02 user nova-compute[73091]:     </interface>
Aug 16 15:05:02 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:05:02 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/console.log" append="off"/>
Aug 16 15:05:02 user nova-compute[73091]:     </serial>
Aug 16 15:05:02 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:05:02 user nova-compute[73091]:     <video>
Aug 16 15:05:02 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:02 user nova-compute[73091]:     </video>
Aug 16 15:05:02 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:05:02 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:05:02 user nova-compute[73091]:     </rng>
Aug 16 15:05:02 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:05:02 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:05:02 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:05:02 user nova-compute[73091]:     </memballoon>
Aug 16 15:05:02 user nova-compute[73091]:   </devices>
Aug 16 15:05:02 user nova-compute[73091]: </domain>
Aug 16 15:05:02 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance destroyed successfully.
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:da:30:1a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:05:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Creating image(s)
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Ensure instance console log exists: /opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Start _get_guest_xml network_info=[{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'fecf6650-879b-4f73-8e3c-03c07d0c2a4d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwzJghat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '416d4daf-aa71-494b-a72b-c978822ca275', 'attached_at': '', 'detached_at': '', 'volume_id': 'e93b636c-81f5-4db4-99a9-deba13b52eb9', 'serial': 'e93b636c-81f5-4db4-99a9-deba13b52eb9'}, 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': '7cdc40ce-ea29-4b1e-92b9-7622a578558e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mADzipwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '416d4daf-aa71-494b-a72b-c978822ca275', 'attached_at': '', 'detached_at': '', 'volume_id': '8e4e0893-8a6d-4df4-bf4a-8a172d04a832', 'serial': '8e4e0893-8a6d-4df4-bf4a-8a172d04a832'}, 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': '71a3d0a5-8cb1-46a7-ae79-2d09e7cac0db', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYhCFuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '416d4daf-aa71-494b-a72b-c978822ca275', 'attached_at': '', 'detached_at': '', 'volume_id': '7ec316be-57f0-4318-9c11-b2d3ea40ff43', 'serial': '7ec316be-57f0-4318-9c11-b2d3ea40ff43'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:05:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwzJghat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:05:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:03 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[677202cb-b799-4343-96ea-f40fd3f979ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:05:03 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041d40e-d2c6-4a13-b3ea-73db1c184a70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9] added
Aug 16 15:05:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.682s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d67fcd-b34a-48bf-bea3-19f2ca746042]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0ae515-6f4f-4fa0-922a-086988a11113]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Deleted allocations for instance 12256aeb-47ca-4171-aca5-9a957c4a7280
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwzJghat {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwzJghat" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe3ed9-a4bd-45de-8719-ab6fc6d36922]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwzJghat'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d58d16-6837-4718-825b-9673e4e0c0cf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e344f1cd-d460-4777-825a-130f30d852bd tempest-TaggedBootDevicesTest_v242-1039307430 tempest-TaggedBootDevicesTest_v242-1039307430-project-member] Lock "12256aeb-47ca-4171-aca5-9a957c4a7280" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 33.367s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a584c-3597-464b-875a-1521e7289f4f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[261bad1d-9165-473b-920c-4e00fb90a71c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260]
Aug 16 15:05:03 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260] successful.
Aug 16 15:05:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[400abc03-621c-4e48-8620-9bbf3fec5a57]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e73a65e-15aa-4cd6-8a45-c36bc33ffd46]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:03 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:03 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f093cbe-a8ad-46d1-aa5e-57a8ab00fae6]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwzJghat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:05:03 user nova-compute[73091]: INFO nova.compute.manager [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Rescuing
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:05:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.586s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== connect_volume: return (3588ms) {'type': 'block', 'scsi_wwn': '23635323662326561', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635323662326561', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-416a3ca5-0bbc-4816-a313-09b08763b177 req-01b35899-840d-48e0-ad36-948e01fc6f7a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-416a3ca5-0bbc-4816-a313-09b08763b177 req-01b35899-840d-48e0-ad36-948e01fc6f7a service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-416a3ca5-0bbc-4816-a313-09b08763b177 req-01b35899-840d-48e0-ad36-948e01fc6f7a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-416a3ca5-0bbc-4816-a313-09b08763b177 req-01b35899-840d-48e0-ad36-948e01fc6f7a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-416a3ca5-0bbc-4816-a313-09b08763b177 req-01b35899-840d-48e0-ad36-948e01fc6f7a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:06 user nova-compute[73091]: WARNING nova.compute.manager [req-416a3ca5-0bbc-4816-a313-09b08763b177 req-01b35899-840d-48e0-ad36-948e01fc6f7a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state rescuing.
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:06 user nova-compute[73091]: WARNING nova.compute.manager [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state rescuing.
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:06 user nova-compute[73091]: WARNING nova.compute.manager [req-ea838bad-3336-492a-99df-2f5782d2ec43 req-953c50e9-b7dd-4aad-a9e6-133f9407204a service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state rescuing.
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for 9498b706-c5d2-4ba8-9d94-bc335fbdca2b due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198306.566498, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:05:06 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Resumed (Lifecycle Event)
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7dc6cfc9-d237-4635-bb2e-3119540214f3 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:06 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:06 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.651447296142578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mADzipwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:05:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:07 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:05:07 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198306.5669153, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:05:07 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Started (Lifecycle Event)
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b708ca02-69f1-4209-960c-fc559468b917]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:05:07 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9032d74-77e7-44d9-a14d-b0834a597759]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832] added
Aug 16 15:05:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6b1a8-0c69-48a7-8326-ab83bba24d3b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b57993-3217-44f1-9d6d-f0ce44bbb96b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mADzipwB {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f87afe3-51c9-4a81-ac75-bbb0a555b041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 416d4daf-aa71-494b-a72b-c978822ca275 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d7711c7-b746-4965-af37-1a9b439c7435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mADzipwB" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd4805-8743-4d92-bc50-3f5a59e8301b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mADzipwB'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65514c64-b97a-488f-b98a-414d2d974a17]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea5934-d5a1-4c2f-9894-b0c11cadc547]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:07 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:07 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b093b-53b0-4d17-b481-f2d1d5db1d18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260]
Aug 16 15:05:07 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260] successful.
Aug 16 15:05:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[157dba07-e7b6-4900-b5cc-a9fe422060e2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cfefa2-118f-4c01-b6d1-6445c3564d04]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:07 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:07 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:07 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:07 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[423960de-45a3-44ef-bec5-ac8f29a36812]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mADzipwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-890c443a-c3bd-4076-bf7d-e07e228e4c9b req-311aa406-24ee-485e-9e46-8c3ddf05e6a5 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-890c443a-c3bd-4076-bf7d-e07e228e4c9b req-311aa406-24ee-485e-9e46-8c3ddf05e6a5 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-890c443a-c3bd-4076-bf7d-e07e228e4c9b req-311aa406-24ee-485e-9e46-8c3ddf05e6a5 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-890c443a-c3bd-4076-bf7d-e07e228e4c9b req-311aa406-24ee-485e-9e46-8c3ddf05e6a5 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-890c443a-c3bd-4076-bf7d-e07e228e4c9b req-311aa406-24ee-485e-9e46-8c3ddf05e6a5 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:08 user nova-compute[73091]: WARNING nova.compute.manager [req-890c443a-c3bd-4076-bf7d-e07e228e4c9b req-311aa406-24ee-485e-9e46-8c3ddf05e6a5 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state rescuing.
Aug 16 15:05:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26330626133626234', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330626133626234', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYhCFuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:05:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:08 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b11cc8c-5c06-488e-93e0-2407757e11eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:05:08 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance destroyed successfully.
Aug 16 15:05:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Attempting a stable device rescue
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a5a38-3e7f-44b5-8887-aba7b037a642]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43] added
Aug 16 15:05:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201c246-c184-485a-aad7-4ea67cc0d002]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7201618-4b2a-4bfe-b516-6b00f3fe9cbd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQYhCFuA {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:05:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Creating image(s)
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'trusted_certs' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQYhCFuA" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc19623f-3a8c-4270-911a-55c5b5057d12]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KQYhCFuA'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "9ea14486199119386dd75b8f17c522eba52d3070" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "9ea14486199119386dd75b8f17c522eba52d3070" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b433f1f-1ea2-49c7-b586-83d54174647a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[182c9821-0157-4a67-8b9c-2c33e722324f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:08 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:08 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:08 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:08 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6084d-1598-4645-8bb6-71292b1b7878]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260]
Aug 16 15:05:09 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260] successful.
Aug 16 15:05:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad269700-0fd4-41bb-845b-6e22d8e6cd6b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219ca9e-99da-4616-aada-b959d7636c8d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:09 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:09 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:09 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:05:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:09 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:09 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:09 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:05:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.286s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c2a819-63b9-402a-af13-7f02d86deb09]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYhCFuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG nova.virt.images [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] dd255c2e-5448-478d-94f0-5b7345972021 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.part /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.part /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.converted" returned: 0 in 0.256s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d50f508-5552-4efd-80a9-4748db1eba40 req-0272b2f0-6ef5-426c-aeb8-d023b7ad8a1d service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d50f508-5552-4efd-80a9-4748db1eba40 req-0272b2f0-6ef5-426c-aeb8-d023b7ad8a1d service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d50f508-5552-4efd-80a9-4748db1eba40 req-0272b2f0-6ef5-426c-aeb8-d023b7ad8a1d service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d50f508-5552-4efd-80a9-4748db1eba40 req-0272b2f0-6ef5-426c-aeb8-d023b7ad8a1d service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d50f508-5552-4efd-80a9-4748db1eba40 req-0272b2f0-6ef5-426c-aeb8-d023b7ad8a1d service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:10 user nova-compute[73091]: WARNING nova.compute.manager [req-1d50f508-5552-4efd-80a9-4748db1eba40 req-0272b2f0-6ef5-426c-aeb8-d023b7ad8a1d service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state rescuing.
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "9ea14486199119386dd75b8f17c522eba52d3070" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.700s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "9ea14486199119386dd75b8f17c522eba52d3070" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "9ea14486199119386dd75b8f17c522eba52d3070" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070 --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070,backing_fmt=raw /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070,backing_fmt=raw /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue" returned: 0 in 0.046s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "9ea14486199119386dd75b8f17c522eba52d3070" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'migration_context' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Start _get_guest_xml network_info=[{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "vif_mac": "fa:16:3e:0b:54:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd255c2e-5448-478d-94f0-5b7345972021', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ae2dd12d-99ac-4ffb-9468-eb5cbf6766ea', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232', 'attached_at': '', 'detached_at': '', 'volume_id': '8a07ad26-a7e6-4d33-85dc-eae180effd2b', 'serial': '8a07ad26-a7e6-4d33-85dc-eae180effd2b'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'resources' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'numa_topology' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:05:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== connect_volume: return (2320ms) {'type': 'block', 'scsi_wwn': '23432333631633732', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432333631633732', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.083s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:05:10 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[934758f7-06c0-4f42-9182-2ceb15029fbc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VdJYDqCG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 15:05:10 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b
Aug 16 15:05:10 user nova-compute[73091]: node.tpgt = -1
Aug 16 15:05:10 user nova-compute[73091]: node.startup = automatic
Aug 16 15:05:10 user nova-compute[73091]: node.leading_login = No
Aug 16 15:05:10 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 16 15:05:10 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.prefix_len = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.transport_name = tcp
Aug 16 15:05:10 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.vlan_id = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.vlan_priority = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.iface_num = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.mtu = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.port = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.bootproto = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.gateway = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.tos_state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.tos = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.ttl = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.redirect = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.header_digest = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.data_digest = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.erl = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.first_burst_len = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.max_burst_len = 0
Aug 16 15:05:10 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 16 15:05:10 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 16 15:05:10 user nova-compute[73091]: node.discovery_address = <empty>
Aug 16 15:05:10 user nova-compute[73091]: node.discovery_port = 0
Aug 16 15:05:10 user nova-compute[73091]: node.discovery_type = static
Aug 16 15:05:10 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 16 15:05:10 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 16 15:05:10 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 16 15:05:10 user nova-compute[73091]: node.session.cmds_max = 128
Aug 16 15:05:10 user nova-compute[73091]: node.session.queue_depth = 32
Aug 16 15:05:10 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 16 15:05:10 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 16 15:05:10 user nova-compute[73091]: node.session.auth.username = VdJYDqCG
Aug 16 15:05:10 user nova-compute[73091]: node.session.auth.password = ***
Aug 16 15:05:10 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 16 15:05:10 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 16 15:05:10 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 16 15:05:10 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 16 15:05:10 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 16 15:05:10 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 15:05:10 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 15:05:10 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 15:05:10 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 16 15:05:10 user nova-compute[73091]: node.session.scan = manual
Aug 16 15:05:10 user nova-compute[73091]: node.session.reopen_max = 0
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].port = 3260
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].startup = manual
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 16 15:05:10 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 16 15:05:10 user nova-compute[73091]: # END RECORD
Aug 16 15:05:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lazy-loading 'pci_devices' on Instance uuid 416d4daf-aa71-494b-a72b-c978822ca275 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c88c30-ce12-4033-beee-9095d305f9c3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:05:10 user nova-compute[73091]:   <uuid>416d4daf-aa71-494b-a72b-c978822ca275</uuid>
Aug 16 15:05:10 user nova-compute[73091]:   <name>instance-00000011</name>
Aug 16 15:05:10 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:05:10 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:05:10 user nova-compute[73091]:   <metadata>
Aug 16 15:05:10 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:05:10 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:05:10 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-1709633691</nova:name>
Aug 16 15:05:10 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:05:03</nova:creationTime>
Aug 16 15:05:10 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:05:10 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:05:10 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:05:10 user nova-compute[73091]:       <nova:owner>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:user uuid="3a0c10fbba48411f944c1bef52e9a246">tempest-TaggedBootDevicesTest-1454900072-project-member</nova:user>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:project uuid="3e3d3941ef45419db169d1b5ff06514c">tempest-TaggedBootDevicesTest-1454900072</nova:project>
Aug 16 15:05:10 user nova-compute[73091]:       </nova:owner>
Aug 16 15:05:10 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:05:10 user nova-compute[73091]:       <nova:ports>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="ad0c68ce-314a-47c2-8230-aeb2faf65634">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="47cd5df7-ddde-4bbe-ad46-617c5ba459ac">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="13d18a09-d88c-481f-beb1-4c28608731b4">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="eb95bba2-1e51-40f4-82dd-49a50b4588ac">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="c5844de6-23b2-4abf-a316-535fa352bd85">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="03117bbc-2aec-47d2-94e3-1184350ae321">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:         <nova:port uuid="fe301652-4ccd-4986-8597-b65c7dacf3f5">
Aug 16 15:05:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 15:05:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:10 user nova-compute[73091]:       </nova:ports>
Aug 16 15:05:10 user nova-compute[73091]:     </nova:instance>
Aug 16 15:05:10 user nova-compute[73091]:   </metadata>
Aug 16 15:05:10 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:05:10 user nova-compute[73091]:     <system>
Aug 16 15:05:10 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:05:10 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:05:10 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:05:10 user nova-compute[73091]:       <entry name="serial">416d4daf-aa71-494b-a72b-c978822ca275</entry>
Aug 16 15:05:10 user nova-compute[73091]:       <entry name="uuid">416d4daf-aa71-494b-a72b-c978822ca275</entry>
Aug 16 15:05:10 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:05:10 user nova-compute[73091]:     </system>
Aug 16 15:05:10 user nova-compute[73091]:   </sysinfo>
Aug 16 15:05:10 user nova-compute[73091]:   <os>
Aug 16 15:05:10 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:05:10 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:05:10 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:05:10 user nova-compute[73091]:   </os>
Aug 16 15:05:10 user nova-compute[73091]:   <features>
Aug 16 15:05:10 user nova-compute[73091]:     <acpi/>
Aug 16 15:05:10 user nova-compute[73091]:     <apic/>
Aug 16 15:05:10 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:05:10 user nova-compute[73091]:   </features>
Aug 16 15:05:10 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:05:10 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:05:10 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:05:10 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:05:10 user nova-compute[73091]:   </clock>
Aug 16 15:05:10 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:05:10 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:05:10 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:05:10 user nova-compute[73091]:   </cpu>
Aug 16 15:05:10 user nova-compute[73091]:   <devices>
Aug 16 15:05:10 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 15:05:10 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 15:05:10 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275/disk.config"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 16 15:05:10 user nova-compute[73091]:     </disk>
Aug 16 15:05:10 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:05:10 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:05:10 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <serial>e93b636c-81f5-4db4-99a9-deba13b52eb9</serial>
Aug 16 15:05:10 user nova-compute[73091]:     </disk>
Aug 16 15:05:10 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:05:10 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:05:10 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <serial>8e4e0893-8a6d-4df4-bf4a-8a172d04a832</serial>
Aug 16 15:05:10 user nova-compute[73091]:     </disk>
Aug 16 15:05:10 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:05:10 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:05:10 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <serial>7ec316be-57f0-4318-9c11-b2d3ea40ff43</serial>
Aug 16 15:05:10 user nova-compute[73091]:     </disk>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:fe:ce:1e"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tapad0c68ce-31"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:b4:48:e0"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tap47cd5df7-dd"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:c6:01:cb"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tap13d18a09-d8"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:47:45:c7"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tapeb95bba2-1e"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:23:1a:6e"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tapc5844de6-23"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:7f:dd:30"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tap03117bbc-2a"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:10 user nova-compute[73091]:       <mac address="fa:16:3e:c8:24:52"/>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:10 user nova-compute[73091]:       <target dev="tapfe301652-4c"/>
Aug 16 15:05:10 user nova-compute[73091]:     </interface>
Aug 16 15:05:10 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:05:10 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275/console.log" append="off"/>
Aug 16 15:05:10 user nova-compute[73091]:     </serial>
Aug 16 15:05:10 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:05:10 user nova-compute[73091]:     <video>
Aug 16 15:05:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:10 user nova-compute[73091]:     </video>
Aug 16 15:05:10 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:05:10 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:05:10 user nova-compute[73091]:     </rng>
Aug 16 15:05:10 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:05:10 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:05:10 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:05:10 user nova-compute[73091]:     </memballoon>
Aug 16 15:05:10 user nova-compute[73091]:   </devices>
Aug 16 15:05:10 user nova-compute[73091]: </domain>
Aug 16 15:05:10 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c7f02-c516-417c-b016-1ffc5e486369]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad0c68ce-31, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad0c68ce-31, col_values=(('external_ids', {'iface-id': 'ad0c68ce-314a-47c2-8230-aeb2faf65634', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ce:1e', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdJYDqCG {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdJYDqCG" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff8f16-2206-4400-a91a-3ea3be75ad7e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdJYDqCG'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31')
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47cd5df7-dd, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47cd5df7-dd, col_values=(('external_ids', {'iface-id': '47cd5df7-ddde-4bbe-ad46-617c5ba459ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:48:e0', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d82577e-4fb5-4d66-a7e9-c2e63fa8b87e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd')
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13d18a09-d8, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13d18a09-d8, col_values=(('external_ids', {'iface-id': '13d18a09-d88c-481f-beb1-4c28608731b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:01:cb', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d78a32d-ae2c-4ad7-a0c3-7c7d8e398396]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:10 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:10 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:05:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:05:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:05:10 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:05:10 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:05:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] HCTL ('38', '0', '0', 0) found on session 12 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc8448-000d-4883-9c61-2d462ba32692]: (4, ('0 0 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching for a device in session 12 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== connect_volume: return (278ms) {'type': 'block', 'scsi_wwn': '23931653364336162', 'path': '/dev/sdg'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653364336162', 'path': '/dev/sdg'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8')
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb95bba2-1e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb95bba2-1e, col_values=(('external_ids', {'iface-id': 'eb95bba2-1e51-40f4-82dd-49a50b4588ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:45:c7', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777760291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777760291',id=13,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-glbmaeaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:03:43Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "vif_mac": "fa:16:3e:0b:54:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "vif_mac": "fa:16:3e:0b:54:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'pci_devices' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:05:11 user nova-compute[73091]:   <uuid>dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232</uuid>
Aug 16 15:05:11 user nova-compute[73091]:   <name>instance-0000000d</name>
Aug 16 15:05:11 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:05:11 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:05:11 user nova-compute[73091]:   <metadata>
Aug 16 15:05:11 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:05:11 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:05:11 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1777760291</nova:name>
Aug 16 15:05:11 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:05:10</nova:creationTime>
Aug 16 15:05:11 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:05:11 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:05:11 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:05:11 user nova-compute[73091]:       <nova:owner>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:user uuid="c0243ed66e484f6a820421b1f69ece02">tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member</nova:user>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:project uuid="7c4d07f3079144a59f93086e00017115">tempest-ServerBootFromVolumeStableRescueTest-909556237</nova:project>
Aug 16 15:05:11 user nova-compute[73091]:       </nova:owner>
Aug 16 15:05:11 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:05:11 user nova-compute[73091]:       <nova:ports>
Aug 16 15:05:11 user nova-compute[73091]:         <nova:port uuid="18c20df6-0c75-4bbf-b421-3d248a2e0d38">
Aug 16 15:05:11 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 15:05:11 user nova-compute[73091]:         </nova:port>
Aug 16 15:05:11 user nova-compute[73091]:       </nova:ports>
Aug 16 15:05:11 user nova-compute[73091]:     </nova:instance>
Aug 16 15:05:11 user nova-compute[73091]:   </metadata>
Aug 16 15:05:11 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:05:11 user nova-compute[73091]:     <system>
Aug 16 15:05:11 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:05:11 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:05:11 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:05:11 user nova-compute[73091]:       <entry name="serial">dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232</entry>
Aug 16 15:05:11 user nova-compute[73091]:       <entry name="uuid">dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232</entry>
Aug 16 15:05:11 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:05:11 user nova-compute[73091]:     </system>
Aug 16 15:05:11 user nova-compute[73091]:   </sysinfo>
Aug 16 15:05:11 user nova-compute[73091]:   <os>
Aug 16 15:05:11 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:05:11 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:05:11 user nova-compute[73091]:   </os>
Aug 16 15:05:11 user nova-compute[73091]:   <features>
Aug 16 15:05:11 user nova-compute[73091]:     <acpi/>
Aug 16 15:05:11 user nova-compute[73091]:     <apic/>
Aug 16 15:05:11 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:05:11 user nova-compute[73091]:   </features>
Aug 16 15:05:11 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:05:11 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:05:11 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:05:11 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:05:11 user nova-compute[73091]:   </clock>
Aug 16 15:05:11 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:05:11 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:05:11 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:05:11 user nova-compute[73091]:   </cpu>
Aug 16 15:05:11 user nova-compute[73091]:   <devices>
Aug 16 15:05:11 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:05:11 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:05:11 user nova-compute[73091]:       <source dev="/dev/sdg"/>
Aug 16 15:05:11 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:05:11 user nova-compute[73091]:       <serial>8a07ad26-a7e6-4d33-85dc-eae180effd2b</serial>
Aug 16 15:05:11 user nova-compute[73091]:     </disk>
Aug 16 15:05:11 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:05:11 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:05:11 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue"/>
Aug 16 15:05:11 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:05:11 user nova-compute[73091]:       <boot order="1"/>
Aug 16 15:05:11 user nova-compute[73091]:     </disk>
Aug 16 15:05:11 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:05:11 user nova-compute[73091]:       <mac address="fa:16:3e:0b:54:a1"/>
Aug 16 15:05:11 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:11 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:05:11 user nova-compute[73091]:       <target dev="tap18c20df6-0c"/>
Aug 16 15:05:11 user nova-compute[73091]:     </interface>
Aug 16 15:05:11 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:05:11 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/console.log" append="off"/>
Aug 16 15:05:11 user nova-compute[73091]:     </serial>
Aug 16 15:05:11 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:05:11 user nova-compute[73091]:     <video>
Aug 16 15:05:11 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:05:11 user nova-compute[73091]:     </video>
Aug 16 15:05:11 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:05:11 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:05:11 user nova-compute[73091]:     </rng>
Aug 16 15:05:11 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:05:11 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:05:11 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:05:11 user nova-compute[73091]:     </memballoon>
Aug 16 15:05:11 user nova-compute[73091]:   </devices>
Aug 16 15:05:11 user nova-compute[73091]: </domain>
Aug 16 15:05:11 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e')
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5844de6-23, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5844de6-23, col_values=(('external_ids', {'iface-id': 'c5844de6-23b2-4abf-a316-535fa352bd85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:1a:6e', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance destroyed successfully.
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23')
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03117bbc-2a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03117bbc-2a, col_values=(('external_ids', {'iface-id': '03117bbc-2aec-47d2-94e3-1184350ae321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:dd:30', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No VIF found with MAC fa:16:3e:0b:54:a1, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a')
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe301652-4c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe301652-4c, col_values=(('external_ids', {'iface-id': 'fe301652-4ccd-4986-8597-b65c7dacf3f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:24:52', 'vm-uuid': '416d4daf-aa71-494b-a72b-c978822ca275'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: INFO os_vif [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c')
Aug 16 15:05:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] No VIF found with MAC fa:16:3e:fe:ce:1e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] No VIF found with MAC fa:16:3e:23:1a:6e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:05:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Using config drive
Aug 16 15:05:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Creating config drive at /opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275/disk.config
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo7ff6t0t {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo7ff6t0t" returned: 0 in 0.074s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-6209613d-0cf7-4be5-a843-9100360df8ee req-26752b11-00d1-40c9-914b-5bb209f2cc51 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6209613d-0cf7-4be5-a843-9100360df8ee req-26752b11-00d1-40c9-914b-5bb209f2cc51 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6209613d-0cf7-4be5-a843-9100360df8ee req-26752b11-00d1-40c9-914b-5bb209f2cc51 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6209613d-0cf7-4be5-a843-9100360df8ee req-26752b11-00d1-40c9-914b-5bb209f2cc51 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-6209613d-0cf7-4be5-a843-9100360df8ee req-26752b11-00d1-40c9-914b-5bb209f2cc51 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:13 user nova-compute[73091]: WARNING nova.compute.manager [req-6209613d-0cf7-4be5-a843-9100360df8ee req-26752b11-00d1-40c9-914b-5bb209f2cc51 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state rescuing.
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d842ed8-032b-4670-8ae7-78ffbc51eb6a req-a57d94a0-420b-43dd-97ca-63991eb71b94 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d842ed8-032b-4670-8ae7-78ffbc51eb6a req-a57d94a0-420b-43dd-97ca-63991eb71b94 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d842ed8-032b-4670-8ae7-78ffbc51eb6a req-a57d94a0-420b-43dd-97ca-63991eb71b94 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d842ed8-032b-4670-8ae7-78ffbc51eb6a req-a57d94a0-420b-43dd-97ca-63991eb71b94 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d842ed8-032b-4670-8ae7-78ffbc51eb6a req-a57d94a0-420b-43dd-97ca-63991eb71b94 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:14 user nova-compute[73091]: WARNING nova.compute.manager [req-7d842ed8-032b-4670-8ae7-78ffbc51eb6a req-a57d94a0-420b-43dd-97ca-63991eb71b94 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 for instance with vm_state building and task_state spawning.
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9314752-e8c2-4a97-aa92-4d37c77c4897 req-f0610cd1-3901-40dd-9f9e-ab01495b54cc service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9314752-e8c2-4a97-aa92-4d37c77c4897 req-f0610cd1-3901-40dd-9f9e-ab01495b54cc service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9314752-e8c2-4a97-aa92-4d37c77c4897 req-f0610cd1-3901-40dd-9f9e-ab01495b54cc service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9314752-e8c2-4a97-aa92-4d37c77c4897 req-f0610cd1-3901-40dd-9f9e-ab01495b54cc service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9314752-e8c2-4a97-aa92-4d37c77c4897 req-f0610cd1-3901-40dd-9f9e-ab01495b54cc service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:15 user nova-compute[73091]: WARNING nova.compute.manager [req-f9314752-e8c2-4a97-aa92-4d37c77c4897 req-f0610cd1-3901-40dd-9f9e-ab01495b54cc service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac for instance with vm_state building and task_state spawning.
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:15 user nova-compute[73091]: WARNING nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state rescuing.
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:15 user nova-compute[73091]: WARNING nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 for instance with vm_state building and task_state spawning.
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:15 user nova-compute[73091]: WARNING nova.compute.manager [req-5be85b3d-d187-442b-ac61-ff563837aed2 req-a4088b9b-072a-4d6d-a829-66b8a7f059cd service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 for instance with vm_state building and task_state spawning.
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:16 user nova-compute[73091]: WARNING nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 for instance with vm_state building and task_state spawning.
Aug 16 15:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:16 user nova-compute[73091]: WARNING nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac for instance with vm_state building and task_state spawning.
Aug 16 15:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:16 user nova-compute[73091]: WARNING nova.compute.manager [req-4b7804ac-dc2b-4abb-974f-73b42ce0d03c req-e476da2b-4ecc-424f-beaa-b53319437272 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac for instance with vm_state building and task_state spawning.
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198317.79848, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:05:17 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Resumed (Lifecycle Event)
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-97708cbc-9d17-4a4a-87cf-43d8463994ba tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-d97a9681-cb8c-4fb8-9fb4-3061a59733cf req-03a5c8da-7181-4314-a99a-ae87083de732 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d97a9681-cb8c-4fb8-9fb4-3061a59733cf req-03a5c8da-7181-4314-a99a-ae87083de732 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d97a9681-cb8c-4fb8-9fb4-3061a59733cf req-03a5c8da-7181-4314-a99a-ae87083de732 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d97a9681-cb8c-4fb8-9fb4-3061a59733cf req-03a5c8da-7181-4314-a99a-ae87083de732 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-d97a9681-cb8c-4fb8-9fb4-3061a59733cf req-03a5c8da-7181-4314-a99a-ae87083de732 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:17 user nova-compute[73091]: WARNING nova.compute.manager [req-d97a9681-cb8c-4fb8-9fb4-3061a59733cf req-03a5c8da-7181-4314-a99a-ae87083de732 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac for instance with vm_state building and task_state spawning.
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:05:17 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198317.8013613, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:05:17 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Started (Lifecycle Event)
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:18 user nova-compute[73091]: WARNING nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 for instance with vm_state building and task_state spawning.
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:18 user nova-compute[73091]: WARNING nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 for instance with vm_state building and task_state spawning.
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:18 user nova-compute[73091]: WARNING nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 for instance with vm_state building and task_state spawning.
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:18 user nova-compute[73091]: WARNING nova.compute.manager [req-4cd67378-bf94-44ed-a29e-a3d257f195fd req-b49d765d-a113-4720-b02b-50a670a97e4f service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 for instance with vm_state building and task_state spawning.
Aug 16 15:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:18 user nova-compute[73091]: WARNING nova.compute.manager [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 for instance with vm_state building and task_state spawning.
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:18 user nova-compute[73091]: WARNING nova.compute.manager [req-b6553180-6b76-489b-8a53-042d54d5e3d1 req-82f336eb-ffd9-4594-b564-8e6777afb157 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 for instance with vm_state building and task_state spawning.
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198319.0850465, 416d4daf-aa71-494b-a72b-c978822ca275 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] VM Resumed (Lifecycle Event)
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance spawned successfully.
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198319.087418, 416d4daf-aa71-494b-a72b-c978822ca275 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] VM Started (Lifecycle Event)
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Took 15.98 seconds to spawn the instance on the hypervisor.
Aug 16 15:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Took 56.10 seconds to build instance.
Aug 16 15:05:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-59f6bf2b-f844-40f0-825d-5188e136e07a tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "416d4daf-aa71-494b-a72b-c978822ca275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.264s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:55 user nova-compute[73091]: INFO nova.compute.manager [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Terminating instance
Aug 16 15:05:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-4feb3dd8-72bd-4f5a-aa52-151e3c701c99 req-0aef5da8-c27f-426f-ba8d-6dcd6860555c service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-vif-unplugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4feb3dd8-72bd-4f5a-aa52-151e3c701c99 req-0aef5da8-c27f-426f-ba8d-6dcd6860555c service nova] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4feb3dd8-72bd-4f5a-aa52-151e3c701c99 req-0aef5da8-c27f-426f-ba8d-6dcd6860555c service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4feb3dd8-72bd-4f5a-aa52-151e3c701c99 req-0aef5da8-c27f-426f-ba8d-6dcd6860555c service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-4feb3dd8-72bd-4f5a-aa52-151e3c701c99 req-0aef5da8-c27f-426f-ba8d-6dcd6860555c service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] No waiting events found dispatching network-vif-unplugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-4feb3dd8-72bd-4f5a-aa52-151e3c701c99 req-0aef5da8-c27f-426f-ba8d-6dcd6860555c service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-vif-unplugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Instance destroyed successfully.
Aug 16 15:05:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lazy-loading 'resources' on Instance uuid 6f87afe3-51c9-4a81-ac75-bbb0a555b041 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2090711129',display_name='tempest-VolumesActionsTest-instance-2090711129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2090711129',id=15,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eecf18330f0441985585318dd8edf13',ramdisk_id='',reservation_id='r-ifypi81q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1670917556',owner_user_name='tempest-VolumesActionsTest-1670917556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:04:15Z,user_data=None,user_id='a9e2d700270c444dbd589941e320cb00',uuid=6f87afe3-51c9-4a81-ac75-bbb0a555b041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converting VIF {"id": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "address": "fa:16:3e:a2:9f:14", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b4c8b9-d5", "ovs_interfaceid": "22b4c8b9-d5cb-404a-bad2-89a4785f4c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG os_vif [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b4c8b9-d5, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:05:56 user nova-compute[73091]: INFO os_vif [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9f:14,bridge_name='br-int',has_traffic_filtering=True,id=22b4c8b9-d5cb-404a-bad2-89a4785f4c6d,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b4c8b9-d5')
Aug 16 15:05:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Deleting instance files /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041_del
Aug 16 15:05:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Deletion of /opt/stack/data/nova/instances/6f87afe3-51c9-4a81-ac75-bbb0a555b041_del complete
Aug 16 15:05:56 user nova-compute[73091]: INFO nova.compute.manager [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 16 15:05:56 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:05:56 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:05:57 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Took 0.65 seconds to deallocate network for instance.
Aug 16 15:05:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-ff83f086-b70f-43b7-ba74-bd6b0eb30d8a req-d6b99479-ed5c-4642-b6a0-bb9ff5fdc668 service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-vif-deleted-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:57 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Deleted allocations for instance 6f87afe3-51c9-4a81-ac75-bbb0a555b041
Aug 16 15:05:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-83e4ff34-934b-4ae1-a592-f34d844571b2 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.429s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cef8ecbf-611f-4199-8c0b-6463d46619fe req-1ff0e3c1-c989-4293-999a-338d71d33a5f service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received event network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cef8ecbf-611f-4199-8c0b-6463d46619fe req-1ff0e3c1-c989-4293-999a-338d71d33a5f service nova] Acquiring lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cef8ecbf-611f-4199-8c0b-6463d46619fe req-1ff0e3c1-c989-4293-999a-338d71d33a5f service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cef8ecbf-611f-4199-8c0b-6463d46619fe req-1ff0e3c1-c989-4293-999a-338d71d33a5f service nova] Lock "6f87afe3-51c9-4a81-ac75-bbb0a555b041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cef8ecbf-611f-4199-8c0b-6463d46619fe req-1ff0e3c1-c989-4293-999a-338d71d33a5f service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] No waiting events found dispatching network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:05:57 user nova-compute[73091]: WARNING nova.compute.manager [req-cef8ecbf-611f-4199-8c0b-6463d46619fe req-1ff0e3c1-c989-4293-999a-338d71d33a5f service nova] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Received unexpected event network-vif-plugged-22b4c8b9-d5cb-404a-bad2-89a4785f4c6d for instance with vm_state deleted and task_state None.
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:05:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:00 user nova-compute[73091]: INFO nova.compute.manager [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Terminating instance
Aug 16 15:06:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Instance destroyed successfully.
Aug 16 15:06:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'resources' on Instance uuid c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-399343472',display_name='tempest-VolumesAdminNegativeTest-server-399343472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-399343472',id=14,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:03:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944792b19ee14226b529478fbfd50dc6',ramdisk_id='',reservation_id='r-120855jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-232748453',owner_user_name='tempest-VolumesAdminNegativeTest-232748453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:03:58Z,user_data=None,user_id='9782834fd235447083d0580b13d518d1',uuid=c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converting VIF {"id": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "address": "fa:16:3e:6e:7e:7c", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3615140-3d", "ovs_interfaceid": "f3615140-3da3-4c4d-b1d6-6a5a366a274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG os_vif [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3615140-3d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:01 user nova-compute[73091]: INFO os_vif [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:7c,bridge_name='br-int',has_traffic_filtering=True,id=f3615140-3da3-4c4d-b1d6-6a5a366a274e,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3615140-3d')
Aug 16 15:06:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Deleting instance files /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de_del
Aug 16 15:06:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Deletion of /opt/stack/data/nova/instances/c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de_del complete
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:01 user nova-compute[73091]: INFO nova.compute.manager [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid 'c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de' (instance-0000000e)
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-9c57c6a1-dff8-4214-890d-ba5706cb8209 req-1f88ab84-1524-4b4a-a740-4efa8cafdb9c service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Received event network-vif-deleted-f3615140-3da3-4c4d-b1d6-6a5a366a274e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:02 user nova-compute[73091]: INFO nova.compute.manager [req-9c57c6a1-dff8-4214-890d-ba5706cb8209 req-1f88ab84-1524-4b4a-a740-4efa8cafdb9c service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Neutron deleted interface f3615140-3da3-4c4d-b1d6-6a5a366a274e; detaching it from the instance and deleting it from the info cache
Aug 16 15:06:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-9c57c6a1-dff8-4214-890d-ba5706cb8209 req-1f88ab84-1524-4b4a-a740-4efa8cafdb9c service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Took 0.55 seconds to deallocate network for instance.
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-9c57c6a1-dff8-4214-890d-ba5706cb8209 req-1f88ab84-1524-4b4a-a740-4efa8cafdb9c service nova] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Detach interface failed, port_id=f3615140-3da3-4c4d-b1d6-6a5a366a274e, reason: Instance c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:02 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Deleted allocations for instance c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1c65efa4-c511-49c2-a991-08738552e1be tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7042MB free_disk=25.556041717529297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 416d4daf-aa71-494b-a72b-c978822ca275 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d7711c7-b746-4965-af37-1a9b439c7435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-changed-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Refreshing instance network info cache due to event network-changed-58cb3a47-39d4-400e-9cb3-05371a448fb6. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] Acquiring lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] Acquired lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Refreshing network info cache for port 58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updated VIF entry in instance network info cache for port 58cb3a47-39d4-400e-9cb3-05371a448fb6. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updating instance_info_cache with network_info: [{"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54e7ad-5c0f-416c-8741-b81b98f22b9a req-78c57e87-5fc2-4fdc-a965-30a557608453 service nova] Releasing lock "refresh_cache-8d21e8b1-c405-4d34-a582-ec36fdefe584" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'flavor' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:05 user nova-compute[73091]: INFO nova.compute.manager [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attaching volume 6e07b9f5-ab80-4ffa-b39c-592d95200cf8 to /dev/vdb
Aug 16 15:06:05 user nova-compute[73091]: DEBUG os_brick.utils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1672907-37e2-41ba-906b-6f09f5580990]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a5e2c-46ef-4a4e-8913-147749d4a489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2733be4d-9595-437c-b077-394d7bc5c69b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4127121-edab-46c3-86e4-0753cafed568]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:05 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:06:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc64ebb6-d3aa-49a2-a459-f4d29d88f10b]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG os_brick.utils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:05 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updating existing volume attachment record: 1794375b-8232-4ea7-8f35-0e039f2490b3 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:06:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:06:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updating instance_info_cache with network_info: [{"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-6f321a3f-b0c8-48f6-8d98-f34e12a3a485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:06:10 user nova-compute[73091]: INFO nova.compute.claims [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Claim successful on node user
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:06:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:06:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:06:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:06:11 user nova-compute[73091]: INFO nova.virt.block_device [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Booting with volume e9dd3520-e6ca-4515-8bd3-66858bb93721 at /dev/vda
Aug 16 15:06:11 user nova-compute[73091]: DEBUG nova.policy [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d227888e574b1ba4c8849fe85282a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc86a892945c4fae9e5187741b6cb65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG os_brick.utils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f91f19-809a-4470-b9a7-74a8e93e9b18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[925e22ec-223c-4f9e-96b6-2325a4f1e071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ab389-cdc9-48fa-b962-cd5ace946285]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[357a61f8-9785-4b09-bc71-237060b3a481]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:11 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:06:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0325b9f2-60ae-4569-8805-fac838034f96]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG os_brick.utils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updating existing volume attachment record: a51048a2-4c3c-408b-92b9-b5ec0e49ded9 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198356.3539374, 6f87afe3-51c9-4a81-ac75-bbb0a555b041 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:11 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] VM Stopped (Lifecycle Event)
Aug 16 15:06:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f3b8e095-4740-4bfa-b0b0-42b223f3a001 None None] [instance: 6f87afe3-51c9-4a81-ac75-bbb0a555b041] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Successfully created port: bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Successfully updated port: bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquired lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-changed-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Refreshing instance network info cache due to event network-changed-bf56269d-0e3e-4ece-98a3-8802f8a708d5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] Acquiring lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:06:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updating instance_info_cache with network_info: [{"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Releasing lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance network_info: |[{"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:06:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] Acquired lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Refreshing network info cache for port bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:06:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updated VIF entry in instance network info cache for port bf56269d-0e3e-4ece-98a3-8802f8a708d5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:06:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updating instance_info_cache with network_info: [{"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2ceb5263-82e3-4d19-abfb-c3c420dda33c req-8441d130-8585-4c04-9c7f-18fbcf9555b3 service nova] Releasing lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198361.380863, c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] VM Stopped (Lifecycle Event)
Aug 16 15:06:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c126ca6a-d42f-4467-a45c-711a9d830b28 None None] [instance: c9f72bd7-0bec-448c-bc3a-02f9a3d9d6de] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:18 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dec8bf7-cebe-45c3-b729-b398f990aa03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:06:18 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a813e8-0503-453e-8413-ac72edb4b891]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8] added
Aug 16 15:06:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e619e0-c09f-44d8-8422-e502c33a0fce]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[218543b4-6064-40f3-8de1-e83886e7b5f6]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOWiaPQJ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOWiaPQJ" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82043b24-43c1-457a-9d69-d2fe9ea051f8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOWiaPQJ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[360975fd-2ab9-46c6-a026-0f00f9f9fabb]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc6563-d7e3-493c-8547-ebaf7debce7d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46a8010-00ea-4b50-9656-48387fbc1139]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]
Aug 16 15:06:18 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.
Aug 16 15:06:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6705a2cf-988e-4c28-8ab8-282ddaba5859]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae1a919-d2b0-4f59-bb30-787ade26f987]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ffbcbf-91e9-46a2-a109-11f5a65e81d6]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:06:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:06:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23633613434613238', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633613434613238', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:06:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'flavor' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:06:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:19 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:06:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:06:19 user nova-compute[73091]:   <serial>6e07b9f5-ab80-4ffa-b39c-592d95200cf8</serial>
Aug 16 15:06:19 user nova-compute[73091]: </disk>
Aug 16 15:06:19 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:06:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No VIF found with MAC fa:16:3e:62:e8:63, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d238648-a12f-4224-9f0f-9497bfcd829e tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.679s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:21 user nova-compute[73091]: INFO nova.compute.manager [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Rebuilding instance
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'resources' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'migration_context' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9680b09-4d2d-4aa7-adea-2ee3ee5ae4d2 req-ac15b130-b836-4723-aea5-5ecda146a08d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-unplugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9680b09-4d2d-4aa7-adea-2ee3ee5ae4d2 req-ac15b130-b836-4723-aea5-5ecda146a08d service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9680b09-4d2d-4aa7-adea-2ee3ee5ae4d2 req-ac15b130-b836-4723-aea5-5ecda146a08d service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9680b09-4d2d-4aa7-adea-2ee3ee5ae4d2 req-ac15b130-b836-4723-aea5-5ecda146a08d service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9680b09-4d2d-4aa7-adea-2ee3ee5ae4d2 req-ac15b130-b836-4723-aea5-5ecda146a08d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-unplugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:22 user nova-compute[73091]: WARNING nova.compute.manager [req-f9680b09-4d2d-4aa7-adea-2ee3ee5ae4d2 req-ac15b130-b836-4723-aea5-5ecda146a08d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-unplugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state active and task_state rebuilding.
Aug 16 15:06:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance destroyed successfully.
Aug 16 15:06:23 user nova-compute[73091]: INFO nova.compute.manager [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Detaching volume 6e07b9f5-ab80-4ffa-b39c-592d95200cf8
Aug 16 15:06:23 user nova-compute[73091]: INFO nova.virt.block_device [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attempting to driver detach volume 6e07b9f5-ab80-4ffa-b39c-592d95200cf8 from mountpoint /dev/vdb
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Attempting to detach device vdb from instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:06:23 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:23 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:06:23 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:06:23 user nova-compute[73091]:   <serial>6e07b9f5-ab80-4ffa-b39c-592d95200cf8</serial>
Aug 16 15:06:23 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:06:23 user nova-compute[73091]: </disk>
Aug 16 15:06:23 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:06:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully detached device vdb from instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 from the persistent domain config.
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faca02e-b1ee-42bd-901e-ad3b8042a328]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[831231f0-b730-42b7-a8ca-b9ea1ebd83e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1154250ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd027f-197e-4316-898c-f62e4b50538b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe41c6c-5de5-4f89-99a9-cd0d44ff881d]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0590121-3e80-4f6b-9e92-b0430d02f723]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba018238-ec8e-4b23-ac94-2cca1ba31084]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c4c1d-c6b6-49f0-9358-09c25eeca565]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:06:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Creating image(s)
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Start _get_guest_xml network_info=[{"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'a51048a2-4c3c-408b-92b9-b5ec0e49ded9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9dd3520-e6ca-4515-8bd3-66858bb93721', 'serial': 'e9dd3520-e6ca-4515-8bd3-66858bb93721'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:06:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a88d9-c2bf-47f5-a15e-78d81e6f1199]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]
Aug 16 15:06:23 user nova-compute[73091]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a21e30-6047-4b3f-88c7-47dcc7834156]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== disconnect_volume: return (349ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.040s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:23 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3532cdb-56b5-42f1-bd96-e10e1857632d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:06:23 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92afaba9-04dc-4029-877a-51068f375711]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721] added
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b68885-f4a0-40d3-8a14-22159f5c1041]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24c42a-8d1f-4e28-af16-0cced50484ed]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxQpUWTR {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxQpUWTR" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feb90d5-b9df-40d5-8f7e-57b587f8dc03]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KxQpUWTR'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40da222c-88b5-4f65-9938-d8ec785bf7f8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa09608-a605-4fee-907a-6916f459f0c8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e50bd-869e-44ad-9bab-42ffbd72310c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]
Aug 16 15:06:23 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.
Aug 16 15:06:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1133c59-a5b6-46ce-8af4-a26f527f10ef]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d26fa8-e76b-4c4a-baea-dc36a2e6e3f9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0b4574-1d98-4803-993b-349a41acb750]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:06:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance destroyed successfully.
Aug 16 15:06:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-659850977',display_name='tempest-ServerActionsTestOtherA-server-852391780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-659850977',id=16,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeWiWE+9Y36hTNKc+fw6eNSTabxWHKknbdUel+a8nBFzXqQa0lYg3YyUCzGRmZrHNtjHJRU5gFgxXjrrOzz7U3DFGvvdVnjDEmR5+IzaV3ICq/c9t4KSv3+veIY46b7Xw==',key_name='tempest-keypair-183354870',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-w3wwu798',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8d21e8b1-c405-4d34-a582-ec36fdefe584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-9879c474-9753-4ea7-82da-430ed9a8a7d7 req-3958d9b4-1907-4bc4-8fec-77829b72f33d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9879c474-9753-4ea7-82da-430ed9a8a7d7 req-3958d9b4-1907-4bc4-8fec-77829b72f33d service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9879c474-9753-4ea7-82da-430ed9a8a7d7 req-3958d9b4-1907-4bc4-8fec-77829b72f33d service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9879c474-9753-4ea7-82da-430ed9a8a7d7 req-3958d9b4-1907-4bc4-8fec-77829b72f33d service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-9879c474-9753-4ea7-82da-430ed9a8a7d7 req-3958d9b4-1907-4bc4-8fec-77829b72f33d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:24 user nova-compute[73091]: WARNING nova.compute.manager [req-9879c474-9753-4ea7-82da-430ed9a8a7d7 req-3958d9b4-1907-4bc4-8fec-77829b72f33d service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state active and task_state rebuilding.
Aug 16 15:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58cb3a47-39, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:24 user nova-compute[73091]: INFO os_vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39')
Aug 16 15:06:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:06:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23834613762303234', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834613762303234', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.465s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1530517513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530517513',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpDK9diB/iGHmTw8zyI03BPzG0gmt19AjpasgRrC2AapJW9WduN0Sn1X12aXf3NAEQELnrpLB54g7QBcvHqnGSsePaPoddcVudgK9ELiSOj78jb5LBn41UHFf62ExadLw==',key_name='tempest-keypair-1560473014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc86a892945c4fae9e5187741b6cb65c',ramdisk_id='',reservation_id='r-dctyxscq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-725797811',owner_user_name='tempest-ServerActionsV293TestJSON-725797811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d227888e574b1ba4c8849fe85282a5',uuid=3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converting VIF {"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d03896-cde5-4b89-8270-36a75f454884]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:06:25 user nova-compute[73091]:   <uuid>3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c</uuid>
Aug 16 15:06:25 user nova-compute[73091]:   <name>instance-00000013</name>
Aug 16 15:06:25 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:06:25 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:06:25 user nova-compute[73091]:   <metadata>
Aug 16 15:06:25 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:25 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:06:25 user nova-compute[73091]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1530517513</nova:name>
Aug 16 15:06:25 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:06:23</nova:creationTime>
Aug 16 15:06:25 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:06:25 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:25 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:06:25 user nova-compute[73091]:       <nova:owner>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:user uuid="27d227888e574b1ba4c8849fe85282a5">tempest-ServerActionsV293TestJSON-725797811-project-member</nova:user>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:project uuid="bc86a892945c4fae9e5187741b6cb65c">tempest-ServerActionsV293TestJSON-725797811</nova:project>
Aug 16 15:06:25 user nova-compute[73091]:       </nova:owner>
Aug 16 15:06:25 user nova-compute[73091]:       <nova:ports>
Aug 16 15:06:25 user nova-compute[73091]:         <nova:port uuid="bf56269d-0e3e-4ece-98a3-8802f8a708d5">
Aug 16 15:06:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 15:06:25 user nova-compute[73091]:         </nova:port>
Aug 16 15:06:25 user nova-compute[73091]:       </nova:ports>
Aug 16 15:06:25 user nova-compute[73091]:     </nova:instance>
Aug 16 15:06:25 user nova-compute[73091]:   </metadata>
Aug 16 15:06:25 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:06:25 user nova-compute[73091]:     <system>
Aug 16 15:06:25 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:06:25 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:06:25 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:06:25 user nova-compute[73091]:       <entry name="serial">3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c</entry>
Aug 16 15:06:25 user nova-compute[73091]:       <entry name="uuid">3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c</entry>
Aug 16 15:06:25 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:06:25 user nova-compute[73091]:     </system>
Aug 16 15:06:25 user nova-compute[73091]:   </sysinfo>
Aug 16 15:06:25 user nova-compute[73091]:   <os>
Aug 16 15:06:25 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:06:25 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:06:25 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:06:25 user nova-compute[73091]:   </os>
Aug 16 15:06:25 user nova-compute[73091]:   <features>
Aug 16 15:06:25 user nova-compute[73091]:     <acpi/>
Aug 16 15:06:25 user nova-compute[73091]:     <apic/>
Aug 16 15:06:25 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:06:25 user nova-compute[73091]:   </features>
Aug 16 15:06:25 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:06:25 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:06:25 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:06:25 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:06:25 user nova-compute[73091]:   </clock>
Aug 16 15:06:25 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:06:25 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:06:25 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:06:25 user nova-compute[73091]:   </cpu>
Aug 16 15:06:25 user nova-compute[73091]:   <devices>
Aug 16 15:06:25 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:06:25 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:25 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 16 15:06:25 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:06:25 user nova-compute[73091]:       <serial>e9dd3520-e6ca-4515-8bd3-66858bb93721</serial>
Aug 16 15:06:25 user nova-compute[73091]:     </disk>
Aug 16 15:06:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:06:25 user nova-compute[73091]:       <mac address="fa:16:3e:2a:9b:29"/>
Aug 16 15:06:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:06:25 user nova-compute[73091]:       <target dev="tapbf56269d-0e"/>
Aug 16 15:06:25 user nova-compute[73091]:     </interface>
Aug 16 15:06:25 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:06:25 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c/console.log" append="off"/>
Aug 16 15:06:25 user nova-compute[73091]:     </serial>
Aug 16 15:06:25 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:06:25 user nova-compute[73091]:     <video>
Aug 16 15:06:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:25 user nova-compute[73091]:     </video>
Aug 16 15:06:25 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:06:25 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:06:25 user nova-compute[73091]:     </rng>
Aug 16 15:06:25 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:06:25 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:06:25 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:06:25 user nova-compute[73091]:     </memballoon>
Aug 16 15:06:25 user nova-compute[73091]:   </devices>
Aug 16 15:06:25 user nova-compute[73091]: </domain>
Aug 16 15:06:25 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1530517513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530517513',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpDK9diB/iGHmTw8zyI03BPzG0gmt19AjpasgRrC2AapJW9WduN0Sn1X12aXf3NAEQELnrpLB54g7QBcvHqnGSsePaPoddcVudgK9ELiSOj78jb5LBn41UHFf62ExadLw==',key_name='tempest-keypair-1560473014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc86a892945c4fae9e5187741b6cb65c',ramdisk_id='',reservation_id='r-dctyxscq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-725797811',owner_user_name='tempest-ServerActionsV293TestJSON-725797811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d227888e574b1ba4c8849fe85282a5',uuid=3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converting VIF {"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_vif [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf56269d-0e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf56269d-0e, col_values=(('external_ids', {'iface-id': 'bf56269d-0e3e-4ece-98a3-8802f8a708d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:9b:29', 'vm-uuid': '3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854f4dc-b0d7-4c00-99b5-f17fdcd7e7e9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11542d7250>, {}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== disconnect_volume: return (527ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:06:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Deleting instance files /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584_del
Aug 16 15:06:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Deletion of /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584_del complete
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:25 user nova-compute[73091]: INFO os_vif [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e')
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:06:25 user nova-compute[73091]: INFO nova.compute.claims [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Claim successful on node user
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] No VIF found with MAC fa:16:3e:2a:9b:29, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:25 user nova-compute[73091]: INFO nova.virt.block_device [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Booting with volume 6e07b9f5-ab80-4ffa-b39c-592d95200cf8 at /dev/vdb
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.utils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d9222-20ec-4f00-bec2-35f5f5154b28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641ce71-5cc6-440c-8b71-377ce7eaaaa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8bc596-6204-40a3-91f6-ff713ff45d85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a49378-af84-4b7f-97e4-6946009358ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:25 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25106c56-4d12-48bd-8aaf-9be72a8958de]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG os_brick.utils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updating existing volume attachment record: e69a0d5e-9d49-433c-bb8e-a40f7b069612 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:06:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.policy [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f6775ee1ca44360920397fd8bbf2899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c198a130ace46eca27de708de492ef7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:06:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Creating image(s)
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk 1073741824" returned: 0 in 0.055s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Successfully created port: 63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-ee2384cb-a002-44cc-82e8-1e48beb4e124 req-a9f593f7-b591-49ff-93bf-41bbde46c851 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee2384cb-a002-44cc-82e8-1e48beb4e124 req-a9f593f7-b591-49ff-93bf-41bbde46c851 service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee2384cb-a002-44cc-82e8-1e48beb4e124 req-a9f593f7-b591-49ff-93bf-41bbde46c851 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee2384cb-a002-44cc-82e8-1e48beb4e124 req-a9f593f7-b591-49ff-93bf-41bbde46c851 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-ee2384cb-a002-44cc-82e8-1e48beb4e124 req-a9f593f7-b591-49ff-93bf-41bbde46c851 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:26 user nova-compute[73091]: WARNING nova.compute.manager [req-ee2384cb-a002-44cc-82e8-1e48beb4e124 req-a9f593f7-b591-49ff-93bf-41bbde46c851 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state building and task_state spawning.
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Cannot resize image /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'migration_context' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Ensure instance console log exists: /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Successfully updated port: 63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing instance network info cache due to event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance network_info: |[{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Start _get_guest_xml network_info=[{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:06:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1432407467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1432407467',id=20,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTdrq52bxwbvCCopZobtCA9IYWKP27UTtYnxFo42/vyruNRnyGf54dmJu8XN2YyXoyW3Zbb6a+qSPV31CAPz2dj0p04rQwXfuvkr5u9sNDyI9Z9wnB11+4LRJp34x5AOg==',key_name='tempest-keypair-1998158073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-1lqullfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=8263a95b-fe6a-45c8-a94e-dccd6ec5f623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'pci_devices' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:06:27 user nova-compute[73091]:   <uuid>8263a95b-fe6a-45c8-a94e-dccd6ec5f623</uuid>
Aug 16 15:06:27 user nova-compute[73091]:   <name>instance-00000014</name>
Aug 16 15:06:27 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:06:27 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:06:27 user nova-compute[73091]:   <metadata>
Aug 16 15:06:27 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:27 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:06:27 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1432407467</nova:name>
Aug 16 15:06:27 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:06:27</nova:creationTime>
Aug 16 15:06:27 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:06:27 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:27 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:06:27 user nova-compute[73091]:       <nova:owner>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:user uuid="0f6775ee1ca44360920397fd8bbf2899">tempest-AttachVolumeShelveTestJSON-1996332630-project-member</nova:user>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:project uuid="0c198a130ace46eca27de708de492ef7">tempest-AttachVolumeShelveTestJSON-1996332630</nova:project>
Aug 16 15:06:27 user nova-compute[73091]:       </nova:owner>
Aug 16 15:06:27 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:27 user nova-compute[73091]:       <nova:ports>
Aug 16 15:06:27 user nova-compute[73091]:         <nova:port uuid="63bacab4-3783-4ad9-8076-c90b88f0d3fc">
Aug 16 15:06:27 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:06:27 user nova-compute[73091]:         </nova:port>
Aug 16 15:06:27 user nova-compute[73091]:       </nova:ports>
Aug 16 15:06:27 user nova-compute[73091]:     </nova:instance>
Aug 16 15:06:27 user nova-compute[73091]:   </metadata>
Aug 16 15:06:27 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:06:27 user nova-compute[73091]:     <system>
Aug 16 15:06:27 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:06:27 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:06:27 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:06:27 user nova-compute[73091]:       <entry name="serial">8263a95b-fe6a-45c8-a94e-dccd6ec5f623</entry>
Aug 16 15:06:27 user nova-compute[73091]:       <entry name="uuid">8263a95b-fe6a-45c8-a94e-dccd6ec5f623</entry>
Aug 16 15:06:27 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:06:27 user nova-compute[73091]:     </system>
Aug 16 15:06:27 user nova-compute[73091]:   </sysinfo>
Aug 16 15:06:27 user nova-compute[73091]:   <os>
Aug 16 15:06:27 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:06:27 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:06:27 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:06:27 user nova-compute[73091]:   </os>
Aug 16 15:06:27 user nova-compute[73091]:   <features>
Aug 16 15:06:27 user nova-compute[73091]:     <acpi/>
Aug 16 15:06:27 user nova-compute[73091]:     <apic/>
Aug 16 15:06:27 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:06:27 user nova-compute[73091]:   </features>
Aug 16 15:06:27 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:06:27 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:06:27 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:06:27 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:06:27 user nova-compute[73091]:   </clock>
Aug 16 15:06:27 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:06:27 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:06:27 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:06:27 user nova-compute[73091]:   </cpu>
Aug 16 15:06:27 user nova-compute[73091]:   <devices>
Aug 16 15:06:27 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:06:27 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:06:27 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk"/>
Aug 16 15:06:27 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:06:27 user nova-compute[73091]:     </disk>
Aug 16 15:06:27 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:06:27 user nova-compute[73091]:       <mac address="fa:16:3e:7f:7e:73"/>
Aug 16 15:06:27 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:27 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:06:27 user nova-compute[73091]:       <target dev="tap63bacab4-37"/>
Aug 16 15:06:27 user nova-compute[73091]:     </interface>
Aug 16 15:06:27 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:06:27 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/console.log" append="off"/>
Aug 16 15:06:27 user nova-compute[73091]:     </serial>
Aug 16 15:06:27 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:06:27 user nova-compute[73091]:     <video>
Aug 16 15:06:27 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:27 user nova-compute[73091]:     </video>
Aug 16 15:06:27 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:06:27 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:06:27 user nova-compute[73091]:     </rng>
Aug 16 15:06:27 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:06:27 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:06:27 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:06:27 user nova-compute[73091]:     </memballoon>
Aug 16 15:06:27 user nova-compute[73091]:   </devices>
Aug 16 15:06:27 user nova-compute[73091]: </domain>
Aug 16 15:06:27 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1432407467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1432407467',id=20,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTdrq52bxwbvCCopZobtCA9IYWKP27UTtYnxFo42/vyruNRnyGf54dmJu8XN2YyXoyW3Zbb6a+qSPV31CAPz2dj0p04rQwXfuvkr5u9sNDyI9Z9wnB11+4LRJp34x5AOg==',key_name='tempest-keypair-1998158073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-1lqullfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=8263a95b-fe6a-45c8-a94e-dccd6ec5f623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG os_vif [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63bacab4-37, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63bacab4-37, col_values=(('external_ids', {'iface-id': '63bacab4-3783-4ad9-8076-c90b88f0d3fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:7e:73', 'vm-uuid': '8263a95b-fe6a-45c8-a94e-dccd6ec5f623'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:27 user nova-compute[73091]: INFO os_vif [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37')
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No VIF found with MAC fa:16:3e:7f:7e:73, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updated VIF entry in instance network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-478c5541-5b2e-46e7-950a-1242b925195f req-e4213739-eab7-49be-9ccb-89fb9a830bc4 service nova] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198388.75866, 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] VM Resumed (Lifecycle Event)
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance spawned successfully.
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-471d8bbc-ea87-46f6-8ecd-997284f631cf req-d5ea3038-c415-46aa-959f-53b319c372cf service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-471d8bbc-ea87-46f6-8ecd-997284f631cf req-d5ea3038-c415-46aa-959f-53b319c372cf service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-471d8bbc-ea87-46f6-8ecd-997284f631cf req-d5ea3038-c415-46aa-959f-53b319c372cf service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-471d8bbc-ea87-46f6-8ecd-997284f631cf req-d5ea3038-c415-46aa-959f-53b319c372cf service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-471d8bbc-ea87-46f6-8ecd-997284f631cf req-d5ea3038-c415-46aa-959f-53b319c372cf service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:28 user nova-compute[73091]: WARNING nova.compute.manager [req-471d8bbc-ea87-46f6-8ecd-997284f631cf req-d5ea3038-c415-46aa-959f-53b319c372cf service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state building and task_state spawning.
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198388.7631338, 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] VM Started (Lifecycle Event)
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 16 15:06:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:28 user nova-compute[73091]: INFO nova.compute.manager [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Took 18.71 seconds to build instance.
Aug 16 15:06:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-afbe1bbf-eff6-442a-93c5-f90b1377178d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.833s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-25b6e0ae-5031-450d-b636-b4445c61bb6f req-8b53726a-0ebd-44d9-9878-b6293824aaa1 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25b6e0ae-5031-450d-b636-b4445c61bb6f req-8b53726a-0ebd-44d9-9878-b6293824aaa1 service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25b6e0ae-5031-450d-b636-b4445c61bb6f req-8b53726a-0ebd-44d9-9878-b6293824aaa1 service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25b6e0ae-5031-450d-b636-b4445c61bb6f req-8b53726a-0ebd-44d9-9878-b6293824aaa1 service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-25b6e0ae-5031-450d-b636-b4445c61bb6f req-8b53726a-0ebd-44d9-9878-b6293824aaa1 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:29 user nova-compute[73091]: WARNING nova.compute.manager [req-25b6e0ae-5031-450d-b636-b4445c61bb6f req-8b53726a-0ebd-44d9-9878-b6293824aaa1 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state building and task_state spawning.
Aug 16 15:06:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-changed-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Refreshing instance network info cache due to event network-changed-87877225-4724-4450-86a5-8bc5484ad81f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] Acquiring lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] Acquired lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Refreshing network info cache for port 87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "interface-8d7711c7-b746-4965-af37-1a9b439c7435-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "interface-8d7711c7-b746-4965-af37-1a9b439c7435-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'flavor' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updated VIF entry in instance network info cache for port 87877225-4724-4450-86a5-8bc5484ad81f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acdd689d-78fa-423a-a876-481ccdc02731 req-287e3ec9-19f7-44d5-b5e0-24bcb661c1de service nova] Releasing lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198391.603661, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] VM Resumed (Lifecycle Event)
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-43fcf78d-e7df-4d22-a906-1662835e8c1b req-8a8b1905-d83d-42ca-87d2-b4d0a57cf718 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43fcf78d-e7df-4d22-a906-1662835e8c1b req-8a8b1905-d83d-42ca-87d2-b4d0a57cf718 service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43fcf78d-e7df-4d22-a906-1662835e8c1b req-8a8b1905-d83d-42ca-87d2-b4d0a57cf718 service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43fcf78d-e7df-4d22-a906-1662835e8c1b req-8a8b1905-d83d-42ca-87d2-b4d0a57cf718 service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-43fcf78d-e7df-4d22-a906-1662835e8c1b req-8a8b1905-d83d-42ca-87d2-b4d0a57cf718 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:31 user nova-compute[73091]: WARNING nova.compute.manager [req-43fcf78d-e7df-4d22-a906-1662835e8c1b req-8a8b1905-d83d-42ca-87d2-b4d0a57cf718 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state building and task_state spawning.
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance spawned successfully.
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.policy [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb68f9de4034c3386d7ccb8333c6f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79780a126247e3afc48a27aed45371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198391.6039574, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] VM Started (Lifecycle Event)
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 16 15:06:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:31 user nova-compute[73091]: INFO nova.compute.manager [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Took 6.75 seconds to build instance.
Aug 16 15:06:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53511edc-86df-46ae-a2c5-1776352f2a75 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Successfully created port: ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:06:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Successfully updated port: ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquired lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-changed-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Refreshing instance network info cache due to event network-changed-ab03fc45-e45e-434a-beea-ec27ed38e359. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] Acquiring lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Releasing lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] Acquired lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Refreshing network info cache for port ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG os_vif [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab03fc45-e4, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab03fc45-e4, col_values=(('external_ids', {'iface-id': 'ab03fc45-e45e-434a-beea-ec27ed38e359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:f2:e1', 'vm-uuid': '8d7711c7-b746-4965-af37-1a9b439c7435'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: INFO os_vif [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4')
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] attach device xml: <interface type="ethernet">
Aug 16 15:06:33 user nova-compute[73091]:   <mac address="fa:16:3e:c1:f2:e1"/>
Aug 16 15:06:33 user nova-compute[73091]:   <model type="virtio"/>
Aug 16 15:06:33 user nova-compute[73091]:   <mtu size="1442"/>
Aug 16 15:06:33 user nova-compute[73091]:   <target dev="tapab03fc45-e4"/>
Aug 16 15:06:33 user nova-compute[73091]: </interface>
Aug 16 15:06:33 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2ded342-eb17-4c09-a8d1-0dde45c131d9 req-d6647b3c-d001-4957-8332-6f40f05af227 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2ded342-eb17-4c09-a8d1-0dde45c131d9 req-d6647b3c-d001-4957-8332-6f40f05af227 service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2ded342-eb17-4c09-a8d1-0dde45c131d9 req-d6647b3c-d001-4957-8332-6f40f05af227 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2ded342-eb17-4c09-a8d1-0dde45c131d9 req-d6647b3c-d001-4957-8332-6f40f05af227 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2ded342-eb17-4c09-a8d1-0dde45c131d9 req-d6647b3c-d001-4957-8332-6f40f05af227 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:34 user nova-compute[73091]: WARNING nova.compute.manager [req-a2ded342-eb17-4c09-a8d1-0dde45c131d9 req-d6647b3c-d001-4957-8332-6f40f05af227 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 for instance with vm_state active and task_state None.
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No VIF found with MAC fa:16:3e:48:1b:e7, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:34 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 16 15:06:34 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-1035689665</nova:name>
Aug 16 15:06:34 user nova-compute[73091]:   <nova:creationTime>2023-08-16 15:06:34</nova:creationTime>
Aug 16 15:06:34 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 16 15:06:34 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:34 user nova-compute[73091]:   </nova:flavor>
Aug 16 15:06:34 user nova-compute[73091]:   <nova:owner>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:user uuid="ebb68f9de4034c3386d7ccb8333c6f45">tempest-TaggedAttachmentsTest-772280576-project-member</nova:user>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:project uuid="df79780a126247e3afc48a27aed45371">tempest-TaggedAttachmentsTest-772280576</nova:project>
Aug 16 15:06:34 user nova-compute[73091]:   </nova:owner>
Aug 16 15:06:34 user nova-compute[73091]:   <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:34 user nova-compute[73091]:   <nova:ports>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:port uuid="87877225-4724-4450-86a5-8bc5484ad81f">
Aug 16 15:06:34 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:06:34 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:34 user nova-compute[73091]:     <nova:port uuid="ab03fc45-e45e-434a-beea-ec27ed38e359">
Aug 16 15:06:34 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Aug 16 15:06:34 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:34 user nova-compute[73091]:   </nova:ports>
Aug 16 15:06:34 user nova-compute[73091]: </nova:instance>
Aug 16 15:06:34 user nova-compute[73091]:  {{(pid=73091) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updated VIF entry in instance network info cache for port ab03fc45-e45e-434a-beea-ec27ed38e359. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea737127-0134-4599-8d2c-9bd399b57f74 req-0f088b6d-0338-4d42-b505-e63afff7c9d8 service nova] Releasing lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1df27ece-c72a-4e41-a84d-7cbe725fe881 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "interface-8d7711c7-b746-4965-af37-1a9b439c7435-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.093s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'flavor' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: INFO nova.compute.manager [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Attaching volume 54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 to /dev/vdb
Aug 16 15:06:35 user nova-compute[73091]: DEBUG os_brick.utils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9008560-342e-4604-b6ac-e5c9b74f70cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0a4e18-aefb-43b7-a4f2-043b5315d015]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[231bde71-9f20-4af8-ac55-6fef1028d291]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7891fb-71b7-4e3e-93ee-57d7d8fe27b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:06:35 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c1821c-2a8a-43bc-952f-8c3252332ef9]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG os_brick.utils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating existing volume attachment record: 3bce87a2-ca6f-44be-a727-0e83d5668b7c {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:35 user nova-compute[73091]: WARNING nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 4481eb2c-88c2-4ada-a08f-31a9c3d325cd {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid b6791c34-3d16-4317-b1ca-f698edda9780 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 416d4daf-aa71-494b-a72b-c978822ca275 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "daf4f67c-fc4a-4386-8347-07c350412126" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: INFO nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "416d4daf-aa71-494b-a72b-c978822ca275" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "416d4daf-aa71-494b-a72b-c978822ca275" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "daf4f67c-fc4a-4386-8347-07c350412126" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-e8871903-86c6-4d62-abf0-d0be446cc155 req-f7426d2a-e0c3-4f38-a814-9fc8677dd4b7 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8871903-86c6-4d62-abf0-d0be446cc155 req-f7426d2a-e0c3-4f38-a814-9fc8677dd4b7 service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8871903-86c6-4d62-abf0-d0be446cc155 req-f7426d2a-e0c3-4f38-a814-9fc8677dd4b7 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8871903-86c6-4d62-abf0-d0be446cc155 req-f7426d2a-e0c3-4f38-a814-9fc8677dd4b7 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-e8871903-86c6-4d62-abf0-d0be446cc155 req-f7426d2a-e0c3-4f38-a814-9fc8677dd4b7 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:36 user nova-compute[73091]: WARNING nova.compute.manager [req-e8871903-86c6-4d62-abf0-d0be446cc155 req-f7426d2a-e0c3-4f38-a814-9fc8677dd4b7 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 for instance with vm_state active and task_state None.
Aug 16 15:06:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:06:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Creating image(s)
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198383.0956614, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:38 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] VM Stopped (Lifecycle Event)
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d71790-5773-4513-87a3-95da0bc28103 None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Cannot resize image /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Ensure instance console log exists: /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Start _get_guest_xml network_info=[{"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'e69a0d5e-9d49-433c-bb8e-a40f7b069612', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d21e8b1-c405-4d34-a582-ec36fdefe584', 'attached_at': '', 'detached_at': '', 'volume_id': '6e07b9f5-ab80-4ffa-b39c-592d95200cf8', 'serial': '6e07b9f5-ab80-4ffa-b39c-592d95200cf8'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:06:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 15:06:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:38 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7be0a-5723-4e77-b5be-64a1ba37d5f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:06:38 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d81712-732b-46dd-85db-32e26d6324be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8] added
Aug 16 15:06:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fde45c-7e6c-4a66-b450-a8fc788af103]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab0325d-34db-4170-900c-db1334713d42]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOWiaPQJ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOWiaPQJ" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84be36-7b35-4380-b915-793121a826ad]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOWiaPQJ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b3dbe-a6f0-4ddc-9442-3ec691f9baae]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef962a64-b849-4173-92e7-ccb2fc0d5cfb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a58533-f8db-45ad-96e6-a1f1e7c55001]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]
Aug 16 15:06:38 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.
Aug 16 15:06:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d936ac-42fa-4018-9f22-a379752e79da]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc705518-53a6-41a6-8adb-41d998857bf9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[418da75d-82cd-46e0-b908-95fa6035f55e]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23633613434613238', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633613434613238', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-659850977',display_name='tempest-ServerActionsTestOtherA-server-852391780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-659850977',id=16,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeWiWE+9Y36hTNKc+fw6eNSTabxWHKknbdUel+a8nBFzXqQa0lYg3YyUCzGRmZrHNtjHJRU5gFgxXjrrOzz7U3DFGvvdVnjDEmR5+IzaV3ICq/c9t4KSv3+veIY46b7Xw==',key_name='tempest-keypair-183354870',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-w3wwu798',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8d21e8b1-c405-4d34-a582-ec36fdefe584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:06:39 user nova-compute[73091]:   <uuid>8d21e8b1-c405-4d34-a582-ec36fdefe584</uuid>
Aug 16 15:06:39 user nova-compute[73091]:   <name>instance-00000010</name>
Aug 16 15:06:39 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:06:39 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:06:39 user nova-compute[73091]:   <metadata>
Aug 16 15:06:39 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:39 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:06:39 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-852391780</nova:name>
Aug 16 15:06:39 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:06:38</nova:creationTime>
Aug 16 15:06:39 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:06:39 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:39 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:06:39 user nova-compute[73091]:       <nova:owner>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:user uuid="40bf98e80707482a9c43719d7a56004a">tempest-ServerActionsTestOtherA-305054434-project-member</nova:user>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:project uuid="99af3ee8a3c64c50a44aa98bcdd05222">tempest-ServerActionsTestOtherA-305054434</nova:project>
Aug 16 15:06:39 user nova-compute[73091]:       </nova:owner>
Aug 16 15:06:39 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:39 user nova-compute[73091]:       <nova:ports>
Aug 16 15:06:39 user nova-compute[73091]:         <nova:port uuid="58cb3a47-39d4-400e-9cb3-05371a448fb6">
Aug 16 15:06:39 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:06:39 user nova-compute[73091]:         </nova:port>
Aug 16 15:06:39 user nova-compute[73091]:       </nova:ports>
Aug 16 15:06:39 user nova-compute[73091]:     </nova:instance>
Aug 16 15:06:39 user nova-compute[73091]:   </metadata>
Aug 16 15:06:39 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:06:39 user nova-compute[73091]:     <system>
Aug 16 15:06:39 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:06:39 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:06:39 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:06:39 user nova-compute[73091]:       <entry name="serial">8d21e8b1-c405-4d34-a582-ec36fdefe584</entry>
Aug 16 15:06:39 user nova-compute[73091]:       <entry name="uuid">8d21e8b1-c405-4d34-a582-ec36fdefe584</entry>
Aug 16 15:06:39 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:06:39 user nova-compute[73091]:     </system>
Aug 16 15:06:39 user nova-compute[73091]:   </sysinfo>
Aug 16 15:06:39 user nova-compute[73091]:   <os>
Aug 16 15:06:39 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:06:39 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:06:39 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:06:39 user nova-compute[73091]:   </os>
Aug 16 15:06:39 user nova-compute[73091]:   <features>
Aug 16 15:06:39 user nova-compute[73091]:     <acpi/>
Aug 16 15:06:39 user nova-compute[73091]:     <apic/>
Aug 16 15:06:39 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:06:39 user nova-compute[73091]:   </features>
Aug 16 15:06:39 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:06:39 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:06:39 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:06:39 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:06:39 user nova-compute[73091]:   </clock>
Aug 16 15:06:39 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:06:39 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:06:39 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:06:39 user nova-compute[73091]:   </cpu>
Aug 16 15:06:39 user nova-compute[73091]:   <devices>
Aug 16 15:06:39 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:06:39 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:06:39 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk"/>
Aug 16 15:06:39 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:06:39 user nova-compute[73091]:     </disk>
Aug 16 15:06:39 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:06:39 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:39 user nova-compute[73091]:       <source dev="/dev/sdf"/>
Aug 16 15:06:39 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:06:39 user nova-compute[73091]:       <serial>6e07b9f5-ab80-4ffa-b39c-592d95200cf8</serial>
Aug 16 15:06:39 user nova-compute[73091]:     </disk>
Aug 16 15:06:39 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:06:39 user nova-compute[73091]:       <mac address="fa:16:3e:62:e8:63"/>
Aug 16 15:06:39 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:39 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:06:39 user nova-compute[73091]:       <target dev="tap58cb3a47-39"/>
Aug 16 15:06:39 user nova-compute[73091]:     </interface>
Aug 16 15:06:39 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:06:39 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/console.log" append="off"/>
Aug 16 15:06:39 user nova-compute[73091]:     </serial>
Aug 16 15:06:39 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:06:39 user nova-compute[73091]:     <video>
Aug 16 15:06:39 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:39 user nova-compute[73091]:     </video>
Aug 16 15:06:39 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:06:39 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:06:39 user nova-compute[73091]:     </rng>
Aug 16 15:06:39 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:06:39 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:06:39 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:06:39 user nova-compute[73091]:     </memballoon>
Aug 16 15:06:39 user nova-compute[73091]:   </devices>
Aug 16 15:06:39 user nova-compute[73091]: </domain>
Aug 16 15:06:39 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-659850977',display_name='tempest-ServerActionsTestOtherA-server-852391780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-659850977',id=16,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeWiWE+9Y36hTNKc+fw6eNSTabxWHKknbdUel+a8nBFzXqQa0lYg3YyUCzGRmZrHNtjHJRU5gFgxXjrrOzz7U3DFGvvdVnjDEmR5+IzaV3ICq/c9t4KSv3+veIY46b7Xw==',key_name='tempest-keypair-183354870',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-w3wwu798',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8d21e8b1-c405-4d34-a582-ec36fdefe584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG os_vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58cb3a47-39, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58cb3a47-39, col_values=(('external_ids', {'iface-id': '58cb3a47-39d4-400e-9cb3-05371a448fb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:e8:63', 'vm-uuid': '8d21e8b1-c405-4d34-a582-ec36fdefe584'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:39 user nova-compute[73091]: INFO os_vif [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39')
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No VIF found with MAC fa:16:3e:62:e8:63, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-877d8d8d-e3de-493d-a9a1-34bb26bdef54 req-29a391f2-033d-4882-8741-cbfd87ea8286 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-877d8d8d-e3de-493d-a9a1-34bb26bdef54 req-29a391f2-033d-4882-8741-cbfd87ea8286 service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-877d8d8d-e3de-493d-a9a1-34bb26bdef54 req-29a391f2-033d-4882-8741-cbfd87ea8286 service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-877d8d8d-e3de-493d-a9a1-34bb26bdef54 req-29a391f2-033d-4882-8741-cbfd87ea8286 service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-877d8d8d-e3de-493d-a9a1-34bb26bdef54 req-29a391f2-033d-4882-8741-cbfd87ea8286 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:41 user nova-compute[73091]: WARNING nova.compute.manager [req-877d8d8d-e3de-493d-a9a1-34bb26bdef54 req-29a391f2-033d-4882-8741-cbfd87ea8286 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 15:06:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-7db24930-7524-41db-8666-4205155b1a87 req-611a117a-549f-4dc7-b25b-510d7479dfcd service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7db24930-7524-41db-8666-4205155b1a87 req-611a117a-549f-4dc7-b25b-510d7479dfcd service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7db24930-7524-41db-8666-4205155b1a87 req-611a117a-549f-4dc7-b25b-510d7479dfcd service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7db24930-7524-41db-8666-4205155b1a87 req-611a117a-549f-4dc7-b25b-510d7479dfcd service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-7db24930-7524-41db-8666-4205155b1a87 req-611a117a-549f-4dc7-b25b-510d7479dfcd service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:43 user nova-compute[73091]: WARNING nova.compute.manager [req-7db24930-7524-41db-8666-4205155b1a87 req-611a117a-549f-4dc7-b25b-510d7479dfcd service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198403.9258404, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:43 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] VM Resumed (Lifecycle Event)
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:06:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance spawned successfully.
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:43 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 15:06:43 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198403.928022, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:43 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] VM Started (Lifecycle Event)
Aug 16 15:06:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 15:06:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 15:06:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f917657-cc87-4e50-ab4a-b6d82fdff48a tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:06:47 user nova-compute[73091]: INFO nova.compute.claims [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Claim successful on node user
Aug 16 15:06:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:06:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:06:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG nova.policy [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9e2d700270c444dbd589941e320cb00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eecf18330f0441985585318dd8edf13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VILuGcrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:48 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:48 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:48 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:06:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Creating image(s)
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "/opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "/opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "/opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.025s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260" returned: 21 in 0.082s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b4443-de3b-4bc7-9295-d9ee8ecea10c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:06:48 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d551a89-5b57-49b3-8c10-26964735fe20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1] added
Aug 16 15:06:48 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.077s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e83d2f-4de8-4cbd-bd07-7897f51c9e4f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.117s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[33979255-171e-4594-b240-61952aea79f0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VILuGcrR {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.273s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VILuGcrR" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69826268-c625-4faa-99f4-589fc9773462]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VILuGcrR'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592c83e-3d2d-4f66-bcaf-ca87993adee0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3217c9d-4775-42dd-bb54-70800034fe48]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ca912-c254-4788-88a0-43429e1a2d97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260]
Aug 16 15:06:48 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260] successful.
Aug 16 15:06:48 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk 1073741824" returned: 0 in 0.055s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[670fd2fa-2a9b-48cc-bb8a-95b5a5fa7b9c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea1c30-f25d-47a0-b1d9-efd5f566a18b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 (non-flash)
Aug 16 15:06:48 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.750s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea3f93-1480-4d10-91b7-b19476b5a164]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:06:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VILuGcrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.242s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Cannot resize image /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lazy-loading 'migration_context' on Instance uuid 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Ensure instance console log exists: /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Successfully created port: 2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.801s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] <== connect_volume: return (1802ms) {'type': 'block', 'scsi_wwn': '26134666139636530', 'path': '/dev/sdh'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134666139636530', 'path': '/dev/sdh'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'flavor' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:06:49 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:49 user nova-compute[73091]:   <source dev="/dev/sdh"/>
Aug 16 15:06:49 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:06:49 user nova-compute[73091]:   <serial>54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1</serial>
Aug 16 15:06:49 user nova-compute[73091]: </disk>
Aug 16 15:06:49 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Successfully updated port: 2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] No VIF found with MAC fa:16:3e:48:1b:e7, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "refresh_cache-693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquired lock "refresh_cache-693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-changed-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Refreshing instance network info cache due to event network-changed-2eb38fde-d792-4d81-bc9c-b4953c1048e8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] Acquiring lock "refresh_cache-693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc2eab6b-9b35-4174-8a7e-cd882afa8116 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.614s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.909s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Updating instance_info_cache with network_info: [{"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Releasing lock "refresh_cache-693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Instance network_info: |[{"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] Acquired lock "refresh_cache-693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Refreshing network info cache for port 2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Start _get_guest_xml network_info=[{"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:06:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-634442717',display_name='tempest-VolumesActionsTest-instance-634442717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-634442717',id=21,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eecf18330f0441985585318dd8edf13',ramdisk_id='',reservation_id='r-3t47iuek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1670917556',owner_user_name='tempest-VolumesActionsTest-1670917556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:48Z,user_data=None,user_id='a9e2d700270c444dbd589941e320cb00',uuid=693b6f64-f23b-438a-8aa6-97f2ed7f9b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converting VIF {"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lazy-loading 'pci_devices' on Instance uuid 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:06:51 user nova-compute[73091]:   <uuid>693b6f64-f23b-438a-8aa6-97f2ed7f9b7c</uuid>
Aug 16 15:06:51 user nova-compute[73091]:   <name>instance-00000015</name>
Aug 16 15:06:51 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:06:51 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:06:51 user nova-compute[73091]:   <metadata>
Aug 16 15:06:51 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:51 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:06:51 user nova-compute[73091]:       <nova:name>tempest-VolumesActionsTest-instance-634442717</nova:name>
Aug 16 15:06:51 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:06:50</nova:creationTime>
Aug 16 15:06:51 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:06:51 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:51 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:06:51 user nova-compute[73091]:       <nova:owner>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:user uuid="a9e2d700270c444dbd589941e320cb00">tempest-VolumesActionsTest-1670917556-project-member</nova:user>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:project uuid="7eecf18330f0441985585318dd8edf13">tempest-VolumesActionsTest-1670917556</nova:project>
Aug 16 15:06:51 user nova-compute[73091]:       </nova:owner>
Aug 16 15:06:51 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:51 user nova-compute[73091]:       <nova:ports>
Aug 16 15:06:51 user nova-compute[73091]:         <nova:port uuid="2eb38fde-d792-4d81-bc9c-b4953c1048e8">
Aug 16 15:06:51 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 15:06:51 user nova-compute[73091]:         </nova:port>
Aug 16 15:06:51 user nova-compute[73091]:       </nova:ports>
Aug 16 15:06:51 user nova-compute[73091]:     </nova:instance>
Aug 16 15:06:51 user nova-compute[73091]:   </metadata>
Aug 16 15:06:51 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:06:51 user nova-compute[73091]:     <system>
Aug 16 15:06:51 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:06:51 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:06:51 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:06:51 user nova-compute[73091]:       <entry name="serial">693b6f64-f23b-438a-8aa6-97f2ed7f9b7c</entry>
Aug 16 15:06:51 user nova-compute[73091]:       <entry name="uuid">693b6f64-f23b-438a-8aa6-97f2ed7f9b7c</entry>
Aug 16 15:06:51 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:06:51 user nova-compute[73091]:     </system>
Aug 16 15:06:51 user nova-compute[73091]:   </sysinfo>
Aug 16 15:06:51 user nova-compute[73091]:   <os>
Aug 16 15:06:51 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:06:51 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:06:51 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:06:51 user nova-compute[73091]:   </os>
Aug 16 15:06:51 user nova-compute[73091]:   <features>
Aug 16 15:06:51 user nova-compute[73091]:     <acpi/>
Aug 16 15:06:51 user nova-compute[73091]:     <apic/>
Aug 16 15:06:51 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:06:51 user nova-compute[73091]:   </features>
Aug 16 15:06:51 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:06:51 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:06:51 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:06:51 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:06:51 user nova-compute[73091]:   </clock>
Aug 16 15:06:51 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:06:51 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:06:51 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:06:51 user nova-compute[73091]:   </cpu>
Aug 16 15:06:51 user nova-compute[73091]:   <devices>
Aug 16 15:06:51 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:06:51 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:06:51 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk"/>
Aug 16 15:06:51 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:06:51 user nova-compute[73091]:     </disk>
Aug 16 15:06:51 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:06:51 user nova-compute[73091]:       <mac address="fa:16:3e:1c:43:2c"/>
Aug 16 15:06:51 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:51 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:06:51 user nova-compute[73091]:       <target dev="tap2eb38fde-d7"/>
Aug 16 15:06:51 user nova-compute[73091]:     </interface>
Aug 16 15:06:51 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:06:51 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/console.log" append="off"/>
Aug 16 15:06:51 user nova-compute[73091]:     </serial>
Aug 16 15:06:51 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:06:51 user nova-compute[73091]:     <video>
Aug 16 15:06:51 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:06:51 user nova-compute[73091]:     </video>
Aug 16 15:06:51 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:06:51 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:06:51 user nova-compute[73091]:     </rng>
Aug 16 15:06:51 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:06:51 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:06:51 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:06:51 user nova-compute[73091]:     </memballoon>
Aug 16 15:06:51 user nova-compute[73091]:   </devices>
Aug 16 15:06:51 user nova-compute[73091]: </domain>
Aug 16 15:06:51 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-634442717',display_name='tempest-VolumesActionsTest-instance-634442717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-634442717',id=21,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eecf18330f0441985585318dd8edf13',ramdisk_id='',reservation_id='r-3t47iuek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1670917556',owner_user_name='tempest-VolumesActionsTest-1670917556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:06:48Z,user_data=None,user_id='a9e2d700270c444dbd589941e320cb00',uuid=693b6f64-f23b-438a-8aa6-97f2ed7f9b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converting VIF {"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG os_vif [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb38fde-d7, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb38fde-d7, col_values=(('external_ids', {'iface-id': '2eb38fde-d792-4d81-bc9c-b4953c1048e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:43:2c', 'vm-uuid': '693b6f64-f23b-438a-8aa6-97f2ed7f9b7c'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:51 user nova-compute[73091]: INFO os_vif [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7')
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] No VIF found with MAC fa:16:3e:1c:43:2c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Updated VIF entry in instance network info cache for port 2eb38fde-d792-4d81-bc9c-b4953c1048e8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Updating instance_info_cache with network_info: [{"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-35c6ec25-0e06-4c1b-b891-1f0bfa7ff50a req-9a1d98d2-98f3-479f-ba21-92ef2bea611d service nova] Releasing lock "refresh_cache-693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:51 user nova-compute[73091]: INFO nova.compute.manager [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Unrescuing
Aug 16 15:06:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:52 user nova-compute[73091]: INFO nova.compute.manager [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Detaching volume 54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1
Aug 16 15:06:52 user nova-compute[73091]: INFO nova.virt.block_device [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Attempting to driver detach volume 54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 from mountpoint /dev/vdb
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Attempting to detach device vdb from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:06:52 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:52 user nova-compute[73091]:   <source dev="/dev/sdh"/>
Aug 16 15:06:52 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:06:52 user nova-compute[73091]:   <serial>54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1</serial>
Aug 16 15:06:52 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 15:06:52 user nova-compute[73091]: </disk>
Aug 16 15:06:52 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:06:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully detached device vdb from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the persistent domain config.
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:06:52 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:06:52 user nova-compute[73091]:   <source dev="/dev/sdh"/>
Aug 16 15:06:52 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:06:52 user nova-compute[73091]:   <serial>54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1</serial>
Aug 16 15:06:52 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 15:06:52 user nova-compute[73091]: </disk>
Aug 16 15:06:52 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'flavor' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-a87de6a9-a6e2-414e-8727-ee665eeaa3df req-c41572f3-d753-4b64-a264-28074d96173d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a87de6a9-a6e2-414e-8727-ee665eeaa3df req-c41572f3-d753-4b64-a264-28074d96173d service nova] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a87de6a9-a6e2-414e-8727-ee665eeaa3df req-c41572f3-d753-4b64-a264-28074d96173d service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a87de6a9-a6e2-414e-8727-ee665eeaa3df req-c41572f3-d753-4b64-a264-28074d96173d service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-a87de6a9-a6e2-414e-8727-ee665eeaa3df req-c41572f3-d753-4b64-a264-28074d96173d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] No waiting events found dispatching network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:52 user nova-compute[73091]: WARNING nova.compute.manager [req-a87de6a9-a6e2-414e-8727-ee665eeaa3df req-c41572f3-d753-4b64-a264-28074d96173d service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received unexpected event network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 for instance with vm_state building and task_state spawning.
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198412.785095, 8d7711c7-b746-4965-af37-1a9b439c7435 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:06:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully detached device vdb from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the live domain config.
Aug 16 15:06:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VILuGcrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:06:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.047s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a664d2-9481-4d35-b9b0-78f1172cac16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b867b4fa-b9a5-408f-acd5-d8a7345f2919]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 (non-flash)
Aug 16 15:06:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c211990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1'): ({'sdh'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Removing single pathed devices sdh {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1a7b1e-42cb-4bc0-b3d8-dcb8f5d05ef9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b575be3d-5b25-4543-ab36-cef4a036c0a9]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Flushing IO for device /dev/sdh {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b854f73-df93-4818-83a0-6634cf7851e9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:06:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9db7c-496c-4917-8514-cabab2677a29]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-1de5b136-9d05-482c-93f4-731f865ac0de req-56d3dcc2-89dd-4167-a73d-ec65ead9405d service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1de5b136-9d05-482c-93f4-731f865ac0de req-56d3dcc2-89dd-4167-a73d-ec65ead9405d service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1de5b136-9d05-482c-93f4-731f865ac0de req-56d3dcc2-89dd-4167-a73d-ec65ead9405d service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1de5b136-9d05-482c-93f4-731f865ac0de req-56d3dcc2-89dd-4167-a73d-ec65ead9405d service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-1de5b136-9d05-482c-93f4-731f865ac0de req-56d3dcc2-89dd-4167-a73d-ec65ead9405d service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:53 user nova-compute[73091]: WARNING nova.compute.manager [req-1de5b136-9d05-482c-93f4-731f865ac0de req-56d3dcc2-89dd-4167-a73d-ec65ead9405d service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b64d9-c24a-447c-8e79-dc2a751f94bd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.115s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fb17df-ed14-4915-b84e-99c943e5ea03]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260]
Aug 16 15:06:53 user nova-compute[73091]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1, portal: 172.16.0.220,3260] successful.
Aug 16 15:06:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a2dcf4-e2c9-4251-b8f6-0b6cbbab4eb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71fa3f7-5146-40ed-b53c-a4a11d56beda]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.499s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] <== disconnect_volume: return (500ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance destroyed successfully.
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'flavor' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1130a9df-8dbf-41e8-a83e-78d8863ba259 tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.546s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-4dec007c-4d6d-4ce3-bc28-e2bcafa3e88a req-b7d15fe7-6120-4f02-b2ad-85098bb591c0 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4dec007c-4d6d-4ce3-bc28-e2bcafa3e88a req-b7d15fe7-6120-4f02-b2ad-85098bb591c0 service nova] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4dec007c-4d6d-4ce3-bc28-e2bcafa3e88a req-b7d15fe7-6120-4f02-b2ad-85098bb591c0 service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4dec007c-4d6d-4ce3-bc28-e2bcafa3e88a req-b7d15fe7-6120-4f02-b2ad-85098bb591c0 service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-4dec007c-4d6d-4ce3-bc28-e2bcafa3e88a req-b7d15fe7-6120-4f02-b2ad-85098bb591c0 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] No waiting events found dispatching network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:54 user nova-compute[73091]: WARNING nova.compute.manager [req-4dec007c-4d6d-4ce3-bc28-e2bcafa3e88a req-b7d15fe7-6120-4f02-b2ad-85098bb591c0 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received unexpected event network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 for instance with vm_state building and task_state spawning.
Aug 16 15:06:55 user nova-compute[73091]: INFO nova.compute.manager [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Unrescuing
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-6775519a-e0c5-41d0-adc9-394c98bd3a35 req-7549eaa2-77c0-4bd5-ba9a-3f83b5e7cce5 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6775519a-e0c5-41d0-adc9-394c98bd3a35 req-7549eaa2-77c0-4bd5-ba9a-3f83b5e7cce5 service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6775519a-e0c5-41d0-adc9-394c98bd3a35 req-7549eaa2-77c0-4bd5-ba9a-3f83b5e7cce5 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6775519a-e0c5-41d0-adc9-394c98bd3a35 req-7549eaa2-77c0-4bd5-ba9a-3f83b5e7cce5 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-6775519a-e0c5-41d0-adc9-394c98bd3a35 req-7549eaa2-77c0-4bd5-ba9a-3f83b5e7cce5 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:55 user nova-compute[73091]: WARNING nova.compute.manager [req-6775519a-e0c5-41d0-adc9-394c98bd3a35 req-7549eaa2-77c0-4bd5-ba9a-3f83b5e7cce5 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "interface-8d7711c7-b746-4965-af37-1a9b439c7435-ab03fc45-e45e-434a-beea-ec27ed38e359" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "interface-8d7711c7-b746-4965-af37-1a9b439c7435-ab03fc45-e45e-434a-beea-ec27ed38e359" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'flavor' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:f2:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapab03fc45-e4"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:f2:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapab03fc45-e4"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Attempting to detach device tapab03fc45-e4 from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] detach device xml: <interface type="ethernet">
Aug 16 15:06:55 user nova-compute[73091]:   <mac address="fa:16:3e:c1:f2:e1"/>
Aug 16 15:06:55 user nova-compute[73091]:   <model type="virtio"/>
Aug 16 15:06:55 user nova-compute[73091]:   <mtu size="1442"/>
Aug 16 15:06:55 user nova-compute[73091]:   <target dev="tapab03fc45-e4"/>
Aug 16 15:06:55 user nova-compute[73091]: </interface>
Aug 16 15:06:55 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:f2:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapab03fc45-e4"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c1:f2:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapab03fc45-e4"/></interface>not found in domain: <domain type='kvm' id='18'>
Aug 16 15:06:55 user nova-compute[73091]:   <name>instance-00000012</name>
Aug 16 15:06:55 user nova-compute[73091]:   <uuid>8d7711c7-b746-4965-af37-1a9b439c7435</uuid>
Aug 16 15:06:55 user nova-compute[73091]:   <metadata>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:55 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 16 15:06:55 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-1035689665</nova:name>
Aug 16 15:06:55 user nova-compute[73091]:   <nova:creationTime>2023-08-16 15:06:34</nova:creationTime>
Aug 16 15:06:55 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 16 15:06:55 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:55 user nova-compute[73091]:   </nova:flavor>
Aug 16 15:06:55 user nova-compute[73091]:   <nova:owner>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:user uuid="ebb68f9de4034c3386d7ccb8333c6f45">tempest-TaggedAttachmentsTest-772280576-project-member</nova:user>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:project uuid="df79780a126247e3afc48a27aed45371">tempest-TaggedAttachmentsTest-772280576</nova:project>
Aug 16 15:06:55 user nova-compute[73091]:   </nova:owner>
Aug 16 15:06:55 user nova-compute[73091]:   <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:55 user nova-compute[73091]:   <nova:ports>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:port uuid="87877225-4724-4450-86a5-8bc5484ad81f">
Aug 16 15:06:55 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:06:55 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:55 user nova-compute[73091]:     <nova:port uuid="ab03fc45-e45e-434a-beea-ec27ed38e359">
Aug 16 15:06:55 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Aug 16 15:06:55 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:55 user nova-compute[73091]:   </nova:ports>
Aug 16 15:06:55 user nova-compute[73091]: </nova:instance>
Aug 16 15:06:55 user nova-compute[73091]:   </metadata>
Aug 16 15:06:55 user nova-compute[73091]:   <memory unit='KiB'>524288</memory>
Aug 16 15:06:55 user nova-compute[73091]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 15:06:55 user nova-compute[73091]:   <vcpu placement='static'>1</vcpu>
Aug 16 15:06:55 user nova-compute[73091]:   <resource>
Aug 16 15:06:55 user nova-compute[73091]:     <partition>/machine</partition>
Aug 16 15:06:55 user nova-compute[73091]:   </resource>
Aug 16 15:06:55 user nova-compute[73091]:   <sysinfo type='smbios'>
Aug 16 15:06:55 user nova-compute[73091]:     <system>
Aug 16 15:06:55 user nova-compute[73091]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 15:06:55 user nova-compute[73091]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 15:06:55 user nova-compute[73091]:       <entry name='version'>0.0.0</entry>
Aug 16 15:06:55 user nova-compute[73091]:       <entry name='serial'>8d7711c7-b746-4965-af37-1a9b439c7435</entry>
Aug 16 15:06:55 user nova-compute[73091]:       <entry name='uuid'>8d7711c7-b746-4965-af37-1a9b439c7435</entry>
Aug 16 15:06:55 user nova-compute[73091]:       <entry name='family'>Virtual Machine</entry>
Aug 16 15:06:55 user nova-compute[73091]:     </system>
Aug 16 15:06:55 user nova-compute[73091]:   </sysinfo>
Aug 16 15:06:55 user nova-compute[73091]:   <os>
Aug 16 15:06:55 user nova-compute[73091]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 15:06:55 user nova-compute[73091]:     <boot dev='hd'/>
Aug 16 15:06:55 user nova-compute[73091]:     <smbios mode='sysinfo'/>
Aug 16 15:06:55 user nova-compute[73091]:   </os>
Aug 16 15:06:55 user nova-compute[73091]:   <features>
Aug 16 15:06:55 user nova-compute[73091]:     <acpi/>
Aug 16 15:06:55 user nova-compute[73091]:     <apic/>
Aug 16 15:06:55 user nova-compute[73091]:     <vmcoreinfo state='on'/>
Aug 16 15:06:55 user nova-compute[73091]:   </features>
Aug 16 15:06:55 user nova-compute[73091]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 15:06:55 user nova-compute[73091]:     <model fallback='forbid'>Nehalem</model>
Aug 16 15:06:55 user nova-compute[73091]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 15:06:55 user nova-compute[73091]:     <feature policy='require' name='vme'/>
Aug 16 15:06:55 user nova-compute[73091]:     <feature policy='require' name='x2apic'/>
Aug 16 15:06:55 user nova-compute[73091]:     <feature policy='require' name='hypervisor'/>
Aug 16 15:06:55 user nova-compute[73091]:   </cpu>
Aug 16 15:06:55 user nova-compute[73091]:   <clock offset='utc'>
Aug 16 15:06:55 user nova-compute[73091]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 15:06:55 user nova-compute[73091]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 15:06:55 user nova-compute[73091]:     <timer name='hpet' present='no'/>
Aug 16 15:06:55 user nova-compute[73091]:   </clock>
Aug 16 15:06:55 user nova-compute[73091]:   <on_poweroff>destroy</on_poweroff>
Aug 16 15:06:55 user nova-compute[73091]:   <on_reboot>restart</on_reboot>
Aug 16 15:06:55 user nova-compute[73091]:   <on_crash>destroy</on_crash>
Aug 16 15:06:55 user nova-compute[73091]:   <devices>
Aug 16 15:06:55 user nova-compute[73091]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 15:06:55 user nova-compute[73091]:     <disk type='file' device='disk'>
Aug 16 15:06:55 user nova-compute[73091]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 15:06:55 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk' index='2'/>
Aug 16 15:06:55 user nova-compute[73091]:       <backingStore type='file' index='3'>
Aug 16 15:06:55 user nova-compute[73091]:         <format type='raw'/>
Aug 16 15:06:55 user nova-compute[73091]:         <source file='/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a'/>
Aug 16 15:06:55 user nova-compute[73091]:         <backingStore/>
Aug 16 15:06:55 user nova-compute[73091]:       </backingStore>
Aug 16 15:06:55 user nova-compute[73091]:       <target dev='vda' bus='virtio'/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='virtio-disk0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </disk>
Aug 16 15:06:55 user nova-compute[73091]:     <disk type='file' device='cdrom'>
Aug 16 15:06:55 user nova-compute[73091]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 15:06:55 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.config' index='1'/>
Aug 16 15:06:55 user nova-compute[73091]:       <backingStore/>
Aug 16 15:06:55 user nova-compute[73091]:       <target dev='hda' bus='ide'/>
Aug 16 15:06:55 user nova-compute[73091]:       <readonly/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='ide0-0-0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </disk>
Aug 16 15:06:55 user nova-compute[73091]:     <controller type='usb' index='0' model='none'>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='usb'/>
Aug 16 15:06:55 user nova-compute[73091]:     </controller>
Aug 16 15:06:55 user nova-compute[73091]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='pci.0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </controller>
Aug 16 15:06:55 user nova-compute[73091]:     <controller type='ide' index='0'>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='ide'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 15:06:55 user nova-compute[73091]:     </controller>
Aug 16 15:06:55 user nova-compute[73091]:     <interface type='ethernet'>
Aug 16 15:06:55 user nova-compute[73091]:       <mac address='fa:16:3e:48:1b:e7'/>
Aug 16 15:06:55 user nova-compute[73091]:       <target dev='tap87877225-47'/>
Aug 16 15:06:55 user nova-compute[73091]:       <model type='virtio'/>
Aug 16 15:06:55 user nova-compute[73091]:       <mtu size='1442'/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='net0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </interface>
Aug 16 15:06:55 user nova-compute[73091]:     <interface type='ethernet'>
Aug 16 15:06:55 user nova-compute[73091]:       <mac address='fa:16:3e:c1:f2:e1'/>
Aug 16 15:06:55 user nova-compute[73091]:       <target dev='tapab03fc45-e4'/>
Aug 16 15:06:55 user nova-compute[73091]:       <model type='virtio'/>
Aug 16 15:06:55 user nova-compute[73091]:       <mtu size='1442'/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='net1'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </interface>
Aug 16 15:06:55 user nova-compute[73091]:     <serial type='pty'>
Aug 16 15:06:55 user nova-compute[73091]:       <source path='/dev/pts/1'/>
Aug 16 15:06:55 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/console.log' append='off'/>
Aug 16 15:06:55 user nova-compute[73091]:       <target type='isa-serial' port='0'>
Aug 16 15:06:55 user nova-compute[73091]:         <model name='isa-serial'/>
Aug 16 15:06:55 user nova-compute[73091]:       </target>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='serial0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </serial>
Aug 16 15:06:55 user nova-compute[73091]:     <console type='pty' tty='/dev/pts/1'>
Aug 16 15:06:55 user nova-compute[73091]:       <source path='/dev/pts/1'/>
Aug 16 15:06:55 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/console.log' append='off'/>
Aug 16 15:06:55 user nova-compute[73091]:       <target type='serial' port='0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='serial0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </console>
Aug 16 15:06:55 user nova-compute[73091]:     <input type='mouse' bus='ps2'>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='input0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </input>
Aug 16 15:06:55 user nova-compute[73091]:     <input type='keyboard' bus='ps2'>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='input1'/>
Aug 16 15:06:55 user nova-compute[73091]:     </input>
Aug 16 15:06:55 user nova-compute[73091]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 16 15:06:55 user nova-compute[73091]:       <listen type='address' address='0.0.0.0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </graphics>
Aug 16 15:06:55 user nova-compute[73091]:     <audio id='1' type='none'/>
Aug 16 15:06:55 user nova-compute[73091]:     <video>
Aug 16 15:06:55 user nova-compute[73091]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='video0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </video>
Aug 16 15:06:55 user nova-compute[73091]:     <memballoon model='virtio'>
Aug 16 15:06:55 user nova-compute[73091]:       <stats period='10'/>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='balloon0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </memballoon>
Aug 16 15:06:55 user nova-compute[73091]:     <rng model='virtio'>
Aug 16 15:06:55 user nova-compute[73091]:       <backend model='random'>/dev/urandom</backend>
Aug 16 15:06:55 user nova-compute[73091]:       <alias name='rng0'/>
Aug 16 15:06:55 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 15:06:55 user nova-compute[73091]:     </rng>
Aug 16 15:06:55 user nova-compute[73091]:   </devices>
Aug 16 15:06:55 user nova-compute[73091]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 15:06:55 user nova-compute[73091]:     <label>libvirt-8d7711c7-b746-4965-af37-1a9b439c7435</label>
Aug 16 15:06:55 user nova-compute[73091]:     <imagelabel>libvirt-8d7711c7-b746-4965-af37-1a9b439c7435</imagelabel>
Aug 16 15:06:55 user nova-compute[73091]:   </seclabel>
Aug 16 15:06:55 user nova-compute[73091]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 15:06:55 user nova-compute[73091]:     <label>+64055:+108</label>
Aug 16 15:06:55 user nova-compute[73091]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 15:06:55 user nova-compute[73091]:   </seclabel>
Aug 16 15:06:55 user nova-compute[73091]: </domain>
Aug 16 15:06:55 user nova-compute[73091]:  {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 15:06:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully detached device tapab03fc45-e4 from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the persistent domain config.
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] (1/8): Attempting to detach device tapab03fc45-e4 with device alias net1 from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] detach device xml: <interface type="ethernet">
Aug 16 15:06:55 user nova-compute[73091]:   <mac address="fa:16:3e:c1:f2:e1"/>
Aug 16 15:06:55 user nova-compute[73091]:   <model type="virtio"/>
Aug 16 15:06:55 user nova-compute[73091]:   <mtu size="1442"/>
Aug 16 15:06:55 user nova-compute[73091]:   <target dev="tapab03fc45-e4"/>
Aug 16 15:06:55 user nova-compute[73091]: </interface>
Aug 16 15:06:55 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198416.0835469, 8d7711c7-b746-4965-af37-1a9b439c7435 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Start waiting for the detach event from libvirt for device tapab03fc45-e4 with device alias net1 for instance 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:f2:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapab03fc45-e4"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c1:f2:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapab03fc45-e4"/></interface>not found in domain: <domain type='kvm' id='18'>
Aug 16 15:06:56 user nova-compute[73091]:   <name>instance-00000012</name>
Aug 16 15:06:56 user nova-compute[73091]:   <uuid>8d7711c7-b746-4965-af37-1a9b439c7435</uuid>
Aug 16 15:06:56 user nova-compute[73091]:   <metadata>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:56 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-1035689665</nova:name>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:creationTime>2023-08-16 15:06:34</nova:creationTime>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 16 15:06:56 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:56 user nova-compute[73091]:   </nova:flavor>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:owner>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:user uuid="ebb68f9de4034c3386d7ccb8333c6f45">tempest-TaggedAttachmentsTest-772280576-project-member</nova:user>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:project uuid="df79780a126247e3afc48a27aed45371">tempest-TaggedAttachmentsTest-772280576</nova:project>
Aug 16 15:06:56 user nova-compute[73091]:   </nova:owner>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:ports>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:port uuid="87877225-4724-4450-86a5-8bc5484ad81f">
Aug 16 15:06:56 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:06:56 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:port uuid="ab03fc45-e45e-434a-beea-ec27ed38e359">
Aug 16 15:06:56 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Aug 16 15:06:56 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:56 user nova-compute[73091]:   </nova:ports>
Aug 16 15:06:56 user nova-compute[73091]: </nova:instance>
Aug 16 15:06:56 user nova-compute[73091]:   </metadata>
Aug 16 15:06:56 user nova-compute[73091]:   <memory unit='KiB'>524288</memory>
Aug 16 15:06:56 user nova-compute[73091]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 15:06:56 user nova-compute[73091]:   <vcpu placement='static'>1</vcpu>
Aug 16 15:06:56 user nova-compute[73091]:   <resource>
Aug 16 15:06:56 user nova-compute[73091]:     <partition>/machine</partition>
Aug 16 15:06:56 user nova-compute[73091]:   </resource>
Aug 16 15:06:56 user nova-compute[73091]:   <sysinfo type='smbios'>
Aug 16 15:06:56 user nova-compute[73091]:     <system>
Aug 16 15:06:56 user nova-compute[73091]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 15:06:56 user nova-compute[73091]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 15:06:56 user nova-compute[73091]:       <entry name='version'>0.0.0</entry>
Aug 16 15:06:56 user nova-compute[73091]:       <entry name='serial'>8d7711c7-b746-4965-af37-1a9b439c7435</entry>
Aug 16 15:06:56 user nova-compute[73091]:       <entry name='uuid'>8d7711c7-b746-4965-af37-1a9b439c7435</entry>
Aug 16 15:06:56 user nova-compute[73091]:       <entry name='family'>Virtual Machine</entry>
Aug 16 15:06:56 user nova-compute[73091]:     </system>
Aug 16 15:06:56 user nova-compute[73091]:   </sysinfo>
Aug 16 15:06:56 user nova-compute[73091]:   <os>
Aug 16 15:06:56 user nova-compute[73091]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 15:06:56 user nova-compute[73091]:     <boot dev='hd'/>
Aug 16 15:06:56 user nova-compute[73091]:     <smbios mode='sysinfo'/>
Aug 16 15:06:56 user nova-compute[73091]:   </os>
Aug 16 15:06:56 user nova-compute[73091]:   <features>
Aug 16 15:06:56 user nova-compute[73091]:     <acpi/>
Aug 16 15:06:56 user nova-compute[73091]:     <apic/>
Aug 16 15:06:56 user nova-compute[73091]:     <vmcoreinfo state='on'/>
Aug 16 15:06:56 user nova-compute[73091]:   </features>
Aug 16 15:06:56 user nova-compute[73091]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 15:06:56 user nova-compute[73091]:     <model fallback='forbid'>Nehalem</model>
Aug 16 15:06:56 user nova-compute[73091]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 15:06:56 user nova-compute[73091]:     <feature policy='require' name='vme'/>
Aug 16 15:06:56 user nova-compute[73091]:     <feature policy='require' name='x2apic'/>
Aug 16 15:06:56 user nova-compute[73091]:     <feature policy='require' name='hypervisor'/>
Aug 16 15:06:56 user nova-compute[73091]:   </cpu>
Aug 16 15:06:56 user nova-compute[73091]:   <clock offset='utc'>
Aug 16 15:06:56 user nova-compute[73091]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 15:06:56 user nova-compute[73091]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 15:06:56 user nova-compute[73091]:     <timer name='hpet' present='no'/>
Aug 16 15:06:56 user nova-compute[73091]:   </clock>
Aug 16 15:06:56 user nova-compute[73091]:   <on_poweroff>destroy</on_poweroff>
Aug 16 15:06:56 user nova-compute[73091]:   <on_reboot>restart</on_reboot>
Aug 16 15:06:56 user nova-compute[73091]:   <on_crash>destroy</on_crash>
Aug 16 15:06:56 user nova-compute[73091]:   <devices>
Aug 16 15:06:56 user nova-compute[73091]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 15:06:56 user nova-compute[73091]:     <disk type='file' device='disk'>
Aug 16 15:06:56 user nova-compute[73091]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 15:06:56 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk' index='2'/>
Aug 16 15:06:56 user nova-compute[73091]:       <backingStore type='file' index='3'>
Aug 16 15:06:56 user nova-compute[73091]:         <format type='raw'/>
Aug 16 15:06:56 user nova-compute[73091]:         <source file='/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a'/>
Aug 16 15:06:56 user nova-compute[73091]:         <backingStore/>
Aug 16 15:06:56 user nova-compute[73091]:       </backingStore>
Aug 16 15:06:56 user nova-compute[73091]:       <target dev='vda' bus='virtio'/>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='virtio-disk0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </disk>
Aug 16 15:06:56 user nova-compute[73091]:     <disk type='file' device='cdrom'>
Aug 16 15:06:56 user nova-compute[73091]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 15:06:56 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk.config' index='1'/>
Aug 16 15:06:56 user nova-compute[73091]:       <backingStore/>
Aug 16 15:06:56 user nova-compute[73091]:       <target dev='hda' bus='ide'/>
Aug 16 15:06:56 user nova-compute[73091]:       <readonly/>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='ide0-0-0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </disk>
Aug 16 15:06:56 user nova-compute[73091]:     <controller type='usb' index='0' model='none'>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='usb'/>
Aug 16 15:06:56 user nova-compute[73091]:     </controller>
Aug 16 15:06:56 user nova-compute[73091]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='pci.0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </controller>
Aug 16 15:06:56 user nova-compute[73091]:     <controller type='ide' index='0'>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='ide'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 15:06:56 user nova-compute[73091]:     </controller>
Aug 16 15:06:56 user nova-compute[73091]:     <interface type='ethernet'>
Aug 16 15:06:56 user nova-compute[73091]:       <mac address='fa:16:3e:48:1b:e7'/>
Aug 16 15:06:56 user nova-compute[73091]:       <target dev='tap87877225-47'/>
Aug 16 15:06:56 user nova-compute[73091]:       <model type='virtio'/>
Aug 16 15:06:56 user nova-compute[73091]:       <mtu size='1442'/>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='net0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </interface>
Aug 16 15:06:56 user nova-compute[73091]:     <serial type='pty'>
Aug 16 15:06:56 user nova-compute[73091]:       <source path='/dev/pts/1'/>
Aug 16 15:06:56 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/console.log' append='off'/>
Aug 16 15:06:56 user nova-compute[73091]:       <target type='isa-serial' port='0'>
Aug 16 15:06:56 user nova-compute[73091]:         <model name='isa-serial'/>
Aug 16 15:06:56 user nova-compute[73091]:       </target>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='serial0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </serial>
Aug 16 15:06:56 user nova-compute[73091]:     <console type='pty' tty='/dev/pts/1'>
Aug 16 15:06:56 user nova-compute[73091]:       <source path='/dev/pts/1'/>
Aug 16 15:06:56 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/console.log' append='off'/>
Aug 16 15:06:56 user nova-compute[73091]:       <target type='serial' port='0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='serial0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </console>
Aug 16 15:06:56 user nova-compute[73091]:     <input type='mouse' bus='ps2'>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='input0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </input>
Aug 16 15:06:56 user nova-compute[73091]:     <input type='keyboard' bus='ps2'>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='input1'/>
Aug 16 15:06:56 user nova-compute[73091]:     </input>
Aug 16 15:06:56 user nova-compute[73091]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 16 15:06:56 user nova-compute[73091]:       <listen type='address' address='0.0.0.0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </graphics>
Aug 16 15:06:56 user nova-compute[73091]:     <audio id='1' type='none'/>
Aug 16 15:06:56 user nova-compute[73091]:     <video>
Aug 16 15:06:56 user nova-compute[73091]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='video0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </video>
Aug 16 15:06:56 user nova-compute[73091]:     <memballoon model='virtio'>
Aug 16 15:06:56 user nova-compute[73091]:       <stats period='10'/>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='balloon0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </memballoon>
Aug 16 15:06:56 user nova-compute[73091]:     <rng model='virtio'>
Aug 16 15:06:56 user nova-compute[73091]:       <backend model='random'>/dev/urandom</backend>
Aug 16 15:06:56 user nova-compute[73091]:       <alias name='rng0'/>
Aug 16 15:06:56 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 15:06:56 user nova-compute[73091]:     </rng>
Aug 16 15:06:56 user nova-compute[73091]:   </devices>
Aug 16 15:06:56 user nova-compute[73091]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 15:06:56 user nova-compute[73091]:     <label>libvirt-8d7711c7-b746-4965-af37-1a9b439c7435</label>
Aug 16 15:06:56 user nova-compute[73091]:     <imagelabel>libvirt-8d7711c7-b746-4965-af37-1a9b439c7435</imagelabel>
Aug 16 15:06:56 user nova-compute[73091]:   </seclabel>
Aug 16 15:06:56 user nova-compute[73091]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 15:06:56 user nova-compute[73091]:     <label>+64055:+108</label>
Aug 16 15:06:56 user nova-compute[73091]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 15:06:56 user nova-compute[73091]:   </seclabel>
Aug 16 15:06:56 user nova-compute[73091]: </domain>
Aug 16 15:06:56 user nova-compute[73091]:  {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully detached device tapab03fc45-e4 from instance 8d7711c7-b746-4965-af37-1a9b439c7435 from the live domain config.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "ab03fc45-e45e-434a-beea-ec27ed38e359", "address": "fa:16:3e:c1:f2:e1", "network": {"id": "945da343-3437-4f66-99ae-9874a388d825", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2049913137", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab03fc45-e4", "ovs_interfaceid": "ab03fc45-e45e-434a-beea-ec27ed38e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG os_vif [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab03fc45-e4, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: INFO os_vif [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f2:e1,bridge_name='br-int',has_traffic_filtering=True,id=ab03fc45-e45e-434a-beea-ec27ed38e359,network=Network(945da343-3437-4f66-99ae-9874a388d825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab03fc45-e4')
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:06:56 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-1035689665</nova:name>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:creationTime>2023-08-16 15:06:56</nova:creationTime>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 16 15:06:56 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 16 15:06:56 user nova-compute[73091]:   </nova:flavor>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:owner>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:user uuid="ebb68f9de4034c3386d7ccb8333c6f45">tempest-TaggedAttachmentsTest-772280576-project-member</nova:user>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:project uuid="df79780a126247e3afc48a27aed45371">tempest-TaggedAttachmentsTest-772280576</nova:project>
Aug 16 15:06:56 user nova-compute[73091]:   </nova:owner>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:06:56 user nova-compute[73091]:   <nova:ports>
Aug 16 15:06:56 user nova-compute[73091]:     <nova:port uuid="87877225-4724-4450-86a5-8bc5484ad81f">
Aug 16 15:06:56 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:06:56 user nova-compute[73091]:     </nova:port>
Aug 16 15:06:56 user nova-compute[73091]:   </nova:ports>
Aug 16 15:06:56 user nova-compute[73091]: </nova:instance>
Aug 16 15:06:56 user nova-compute[73091]:  {{(pid=73091) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198416.3187182, 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] VM Resumed (Lifecycle Event)
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'flavor' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Instance spawned successfully.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198416.3188744, 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] VM Started (Lifecycle Event)
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Took 8.28 seconds to spawn the instance on the hypervisor.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: INFO nova.compute.manager [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Took 9.28 seconds to build instance.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-03513075-442c-4805-b5ec-9db07c46ac60 req-0a0b9590-8298-40a9-a9ff-ce7216688e13 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-unplugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-03513075-442c-4805-b5ec-9db07c46ac60 req-0a0b9590-8298-40a9-a9ff-ce7216688e13 service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-03513075-442c-4805-b5ec-9db07c46ac60 req-0a0b9590-8298-40a9-a9ff-ce7216688e13 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-03513075-442c-4805-b5ec-9db07c46ac60 req-0a0b9590-8298-40a9-a9ff-ce7216688e13 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-03513075-442c-4805-b5ec-9db07c46ac60 req-0a0b9590-8298-40a9-a9ff-ce7216688e13 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-unplugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:56 user nova-compute[73091]: WARNING nova.compute.manager [req-03513075-442c-4805-b5ec-9db07c46ac60 req-0a0b9590-8298-40a9-a9ff-ce7216688e13 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-unplugged-ab03fc45-e45e-434a-beea-ec27ed38e359 for instance with vm_state active and task_state None.
Aug 16 15:06:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6656dfdc-c336-4321-b646-f15528f95911 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.435s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance destroyed successfully.
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquired lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:58 user nova-compute[73091]: INFO nova.network.neutron [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Port ab03fc45-e45e-434a-beea-ec27ed38e359 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [{"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Releasing lock "refresh_cache-8d7711c7-b746-4965-af37-1a9b439c7435" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09f1c3e3-d2bd-44eb-a635-4a8f82fd6c6b tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "interface-8d7711c7-b746-4965-af37-1a9b439c7435-ab03fc45-e45e-434a-beea-ec27ed38e359" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.864s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for 9498b706-c5d2-4ba8-9d94-bc335fbdca2b due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198418.572483, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Resumed (Lifecycle Event)
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-11005c63-e1c8-4e55-8389-9025bccda977 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198418.5726066, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:06:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Started (Lifecycle Event)
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:58 user nova-compute[73091]: WARNING nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-plugged-ab03fc45-e45e-434a-beea-ec27ed38e359 for instance with vm_state active and task_state None.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-deleted-ab03fc45-e45e-434a-beea-ec27ed38e359 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:58 user nova-compute[73091]: WARNING nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:58 user nova-compute[73091]: WARNING nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:58 user nova-compute[73091]: WARNING nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:06:58 user nova-compute[73091]: WARNING nova.compute.manager [req-be8effb8-674d-472c-af57-d09992dc2862 req-0eb4cf56-a58f-4c1d-9e7e-e6d41933b1d9 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:06:59 user nova-compute[73091]: INFO nova.compute.manager [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Terminating instance
Aug 16 15:06:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Instance destroyed successfully.
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lazy-loading 'resources' on Instance uuid 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-82411913',display_name='tempest-VolumesAdminNegativeTest-server-82411913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-82411913',id=8,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEcHp548jOdxE73ukDOYJO+cFcGDeU2LTX6JnfUUpX/X1HTKGvmcYH/T9KuSq99aFFt8SW0xKuEUTuEWUpMtFtR7rC3en6Nkgg2f3uvJTOSS/Tkq5QWk3YDs9BCrNG2A==',key_name='tempest-keypair-1700635037',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944792b19ee14226b529478fbfd50dc6',ramdisk_id='',reservation_id='r-i99nt01s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-232748453',owner_user_name='tempest-VolumesAdminNegativeTest-232748453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9782834fd235447083d0580b13d518d1',uuid=6f321a3f-b0c8-48f6-8d98-f34e12a3a485,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converting VIF {"id": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "address": "fa:16:3e:64:7c:2e", "network": {"id": "ea720f34-f172-42c5-8097-d007471df546", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-458825122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944792b19ee14226b529478fbfd50dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap655ea32b-44", "ovs_interfaceid": "655ea32b-442a-4017-b2d9-1ee7e4d2aa8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG os_vif [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap655ea32b-44, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:00 user nova-compute[73091]: INFO os_vif [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=655ea32b-442a-4017-b2d9-1ee7e4d2aa8f,network=Network(ea720f34-f172-42c5-8097-d007471df546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655ea32b-44')
Aug 16 15:07:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Deleting instance files /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485_del
Aug 16 15:07:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Deletion of /opt/stack/data/nova/instances/6f321a3f-b0c8-48f6-8d98-f34e12a3a485_del complete
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:00 user nova-compute[73091]: INFO nova.compute.manager [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:00 user nova-compute[73091]: WARNING nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:00 user nova-compute[73091]: WARNING nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:00 user nova-compute[73091]: WARNING nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:00 user nova-compute[73091]: WARNING nova.compute.manager [req-dc0f8c39-8768-4184-b35d-ee19f2127b3a req-06c4dde4-d303-43e8-b0b9-37b8874b1a94 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198421.7854514, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:07:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Resumed (Lifecycle Event)
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af60e277-c0f1-4df0-ab77-6a40017020be tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:07:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198421.800116, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:07:01 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Started (Lifecycle Event)
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Took 1.36 seconds to deallocate network for instance.
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2593d0b-e25b-49ad-a6cd-efd70b050ada req-c34da311-d3ba-4ed6-9d5d-45ab8f4fc481 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2593d0b-e25b-49ad-a6cd-efd70b050ada req-c34da311-d3ba-4ed6-9d5d-45ab8f4fc481 service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2593d0b-e25b-49ad-a6cd-efd70b050ada req-c34da311-d3ba-4ed6-9d5d-45ab8f4fc481 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2593d0b-e25b-49ad-a6cd-efd70b050ada req-c34da311-d3ba-4ed6-9d5d-45ab8f4fc481 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2593d0b-e25b-49ad-a6cd-efd70b050ada req-c34da311-d3ba-4ed6-9d5d-45ab8f4fc481 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:02 user nova-compute[73091]: WARNING nova.compute.manager [req-a2593d0b-e25b-49ad-a6cd-efd70b050ada req-c34da311-d3ba-4ed6-9d5d-45ab8f4fc481 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state None.
Aug 16 15:07:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8384272-d04d-4b58-b96b-2e39f93e0723 req-cb05a7ad-d47b-4268-901e-ad427a843dd6 service nova] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Received event network-vif-deleted-655ea32b-442a-4017-b2d9-1ee7e4d2aa8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:07:02 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Deleted allocations for instance 6f321a3f-b0c8-48f6-8d98-f34e12a3a485
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cb678a1c-f9f5-4d02-b6f0-23e3b6a99b47 tempest-VolumesAdminNegativeTest-232748453 tempest-VolumesAdminNegativeTest-232748453-project-member] Lock "6f321a3f-b0c8-48f6-8d98-f34e12a3a485" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.479s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-0061a457-984d-4783-869b-f380bcb71136 req-80c24c06-1dd0-4c8d-b0ac-af6210ccb6a7 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0061a457-984d-4783-869b-f380bcb71136 req-80c24c06-1dd0-4c8d-b0ac-af6210ccb6a7 service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0061a457-984d-4783-869b-f380bcb71136 req-80c24c06-1dd0-4c8d-b0ac-af6210ccb6a7 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0061a457-984d-4783-869b-f380bcb71136 req-80c24c06-1dd0-4c8d-b0ac-af6210ccb6a7 service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-0061a457-984d-4783-869b-f380bcb71136 req-80c24c06-1dd0-4c8d-b0ac-af6210ccb6a7 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:04 user nova-compute[73091]: WARNING nova.compute.manager [req-0061a457-984d-4783-869b-f380bcb71136 req-80c24c06-1dd0-4c8d-b0ac-af6210ccb6a7 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state active and task_state None.
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-changed-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing instance network info cache due to event network-changed-ad0c68ce-314a-47c2-8230-aeb2faf65634. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] Acquiring lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] Acquired lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Refreshing network info cache for port ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:07:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:07:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7011MB free_disk=25.574283599853516GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 416d4daf-aa71-494b-a72b-c978822ca275 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d7711c7-b746-4965-af37-1a9b439c7435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:07:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updated VIF entry in instance network info cache for port ad0c68ce-314a-47c2-8230-aeb2faf65634. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d8f2dba5-5922-4b9b-b2fe-31187cd881d3 req-4f87bd39-62fb-4e49-8fcf-bb76fed66f9e service nova] Releasing lock "refresh_cache-416d4daf-aa71-494b-a72b-c978822ca275" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "416d4daf-aa71-494b-a72b-c978822ca275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:07 user nova-compute[73091]: INFO nova.compute.manager [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Terminating instance
Aug 16 15:07:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-7435f621-b683-40a0-adca-e7a28449a5d1 req-660e98d2-abe7-4428-876c-001679204647 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7435f621-b683-40a0-adca-e7a28449a5d1 req-660e98d2-abe7-4428-876c-001679204647 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7435f621-b683-40a0-adca-e7a28449a5d1 req-660e98d2-abe7-4428-876c-001679204647 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7435f621-b683-40a0-adca-e7a28449a5d1 req-660e98d2-abe7-4428-876c-001679204647 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-7435f621-b683-40a0-adca-e7a28449a5d1 req-660e98d2-abe7-4428-876c-001679204647 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-7435f621-b683-40a0-adca-e7a28449a5d1 req-660e98d2-abe7-4428-876c-001679204647 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-692cb239-c6e8-46b0-8c5a-faee5818c337 req-170ace8f-8087-4b41-bb8d-7af0fbccf075 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-692cb239-c6e8-46b0-8c5a-faee5818c337 req-170ace8f-8087-4b41-bb8d-7af0fbccf075 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-692cb239-c6e8-46b0-8c5a-faee5818c337 req-170ace8f-8087-4b41-bb8d-7af0fbccf075 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-692cb239-c6e8-46b0-8c5a-faee5818c337 req-170ace8f-8087-4b41-bb8d-7af0fbccf075 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-692cb239-c6e8-46b0-8c5a-faee5818c337 req-170ace8f-8087-4b41-bb8d-7af0fbccf075 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-692cb239-c6e8-46b0-8c5a-faee5818c337 req-170ace8f-8087-4b41-bb8d-7af0fbccf075 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-13d18a09-d88c-481f-beb1-4c28608731b4 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-d74f0957-6667-42de-9adb-8bfefa1d225c req-46840ed1-2ed4-470e-b038-4bb8f45f37ee service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d74f0957-6667-42de-9adb-8bfefa1d225c req-46840ed1-2ed4-470e-b038-4bb8f45f37ee service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d74f0957-6667-42de-9adb-8bfefa1d225c req-46840ed1-2ed4-470e-b038-4bb8f45f37ee service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d74f0957-6667-42de-9adb-8bfefa1d225c req-46840ed1-2ed4-470e-b038-4bb8f45f37ee service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-d74f0957-6667-42de-9adb-8bfefa1d225c req-46840ed1-2ed4-470e-b038-4bb8f45f37ee service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-d74f0957-6667-42de-9adb-8bfefa1d225c req-46840ed1-2ed4-470e-b038-4bb8f45f37ee service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Instance destroyed successfully.
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lazy-loading 'resources' on Instance uuid 416d4daf-aa71-494b-a72b-c978822ca275 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad0c68ce-31, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ce:1e,bridge_name='br-int',has_traffic_filtering=True,id=ad0c68ce-314a-47c2-8230-aeb2faf65634,network=Network(dd344320-54b6-4661-8402-69c4cb756065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0c68ce-31')
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47cd5df7-dd, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:48:e0,bridge_name='br-int',has_traffic_filtering=True,id=47cd5df7-ddde-4bbe-ad46-617c5ba459ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap47cd5df7-dd')
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13d18a09-d8, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:01:cb,bridge_name='br-int',has_traffic_filtering=True,id=13d18a09-d88c-481f-beb1-4c28608731b4,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d18a09-d8')
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb95bba2-1e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:45:c7,bridge_name='br-int',has_traffic_filtering=True,id=eb95bba2-1e51-40f4-82dd-49a50b4588ac,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb95bba2-1e')
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "c5844de6-23b2-4abf-a316-535fa352bd85", "address": "fa:16:3e:23:1a:6e", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5844de6-23", "ovs_interfaceid": "c5844de6-23b2-4abf-a316-535fa352bd85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5844de6-23, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:6e,bridge_name='br-int',has_traffic_filtering=True,id=c5844de6-23b2-4abf-a316-535fa352bd85,network=Network(8f079a8a-ea6e-4c2c-9434-3475678f257e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5844de6-23')
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03117bbc-2a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:30,bridge_name='br-int',has_traffic_filtering=True,id=03117bbc-2aec-47d2-94e3-1184350ae321,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03117bbc-2a')
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709633691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709633691',id=17,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONaRF+fPS+1bWyZrrktGdPfd4vWxuoZRTO2YDq3RvbJFCnWPhfnBZkLBN6tiZQZYIpbkM69s6/J7FxIlE8hMJcNy5OMgYrfzdlknavE1nSLj1C7w55zMbL9gQrQe/OL1A==',key_name='tempest-keypair-1151121414',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3d3941ef45419db169d1b5ff06514c',ramdisk_id='',reservation_id='r-s8bt5jmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1454900072',owner_user_name='tempest-TaggedBootDevicesTest-1454900072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0c10fbba48411f944c1bef52e9a246',uuid=416d4daf-aa71-494b-a72b-c978822ca275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converting VIF {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe301652-4c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:10 user nova-compute[73091]: INFO os_vif [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:52,bridge_name='br-int',has_traffic_filtering=True,id=fe301652-4ccd-4986-8597-b65c7dacf3f5,network=Network(1be5a8ed-f3a9-4173-8e50-b0247481bcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe301652-4c')
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYhCFuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e9fd43-e0f8-4405-b82e-460dd7413dc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd4f0f-db58-44fc-9275-826a462c1c11]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115444bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18085999-d215-4cc3-af70-c5e440b47195]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c741808-7b5a-4299-86e6-9232ff94df1f]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c20f3-4469-4926-9f95-4646402e2f28]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-ad0c68ce-314a-47c2-8230-aeb2faf65634 for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-47cd5df7-ddde-4bbe-ad46-617c5ba459ac for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-cb98df2d-b943-4c60-bfc3-127576c3a978 req-e44996e7-d6ce-46e6-958c-292068e31954 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-fe301652-4ccd-4986-8597-b65c7dacf3f5 for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8ea6e-2e74-4160-922b-8f60769aac39]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe2061-866e-46c9-a6d4-042af7eb6711]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c001391-ef66-499d-ade7-020f4305f45c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260]
Aug 16 15:07:10 user nova-compute[73091]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43, portal: 172.16.0.220,3260] successful.
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec316be-57f0-4318-9c11-b2d3ea40ff43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fbdb15-2643-4774-be13-7fd1982de344]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== disconnect_volume: return (350ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mADzipwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6e4e0c-1d09-4ca0-8467-5a0301ae7868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-13d18a09-d88c-481f-beb1-4c28608731b4 for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-c5844de6-23b2-4abf-a316-535fa352bd85 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-c5844de6-23b2-4abf-a316-535fa352bd85 for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-unplugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-unplugged-03117bbc-2aec-47d2-94e3-1184350ae321 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-eaa6702b-3b95-4fa4-bf72-14b5d7f39d3f req-070bc484-d354-45dc-b3f3-7872c483af4a service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-03117bbc-2aec-47d2-94e3-1184350ae321 for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da4e91-7959-437c-acb5-1a32634bcc96]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115428d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58dab31-802b-43c9-9aa9-ade6929a4dc5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32f5531-3f29-4669-9250-537872cf410c]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a1402-88e2-4187-ba4c-9dbe718839ab]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab387c-26ae-4b94-b924-45c099b4fedb]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63afabcb-3116-4c6f-bef0-a7e46dfc9a2d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b3ac8a-53f5-4e86-9306-d69ed1e3f789]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260]
Aug 16 15:07:10 user nova-compute[73091]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832, portal: 172.16.0.220,3260] successful.
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e4e0893-8a6d-4df4-bf4a-8a172d04a832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c05df-1f3c-4ed1-b812-abc637ad3cea]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== disconnect_volume: return (311ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwzJghat', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-5e8a6de3-f696-4c72-9ee9-e776a5eca3ab req-a5450c80-9f67-41c1-9553-ee698edb9d2e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5e8a6de3-f696-4c72-9ee9-e776a5eca3ab req-a5450c80-9f67-41c1-9553-ee698edb9d2e service nova] Acquiring lock "416d4daf-aa71-494b-a72b-c978822ca275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5e8a6de3-f696-4c72-9ee9-e776a5eca3ab req-a5450c80-9f67-41c1-9553-ee698edb9d2e service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5e8a6de3-f696-4c72-9ee9-e776a5eca3ab req-a5450c80-9f67-41c1-9553-ee698edb9d2e service nova] Lock "416d4daf-aa71-494b-a72b-c978822ca275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-5e8a6de3-f696-4c72-9ee9-e776a5eca3ab req-a5450c80-9f67-41c1-9553-ee698edb9d2e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] No waiting events found dispatching network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:10 user nova-compute[73091]: WARNING nova.compute.manager [req-5e8a6de3-f696-4c72-9ee9-e776a5eca3ab req-a5450c80-9f67-41c1-9553-ee698edb9d2e service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received unexpected event network-vif-plugged-eb95bba2-1e51-40f4-82dd-49a50b4588ac for instance with vm_state active and task_state deleting.
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2d356-bba5-4009-b2bb-1a31674f2476]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1dae5-3025-46fd-84c0-34fc6ed7084d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:07:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115428c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb4d5b-61c8-41c0-947e-937984f3d083]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f55e885-5e3a-4ee0-9fa8-7cf0aa135aeb]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79d06d-6f7e-4101-b98c-a84c8d79d449]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b1635-bd1a-4f66-863c-efb926f8b9f3]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffea667-d465-4106-beba-b1c5640bb1a5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66351df-40e4-4080-9f74-44dd9c10a109]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260]
Aug 16 15:07:11 user nova-compute[73091]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9, portal: 172.16.0.220,3260] successful.
Aug 16 15:07:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93b636c-81f5-4db4-99a9-deba13b52eb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e8d3c-5e7d-4082-85ca-a497bfc8e978]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] <== disconnect_volume: return (282ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:07:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Deleting instance files /opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275_del
Aug 16 15:07:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Deletion of /opt/stack/data/nova/instances/416d4daf-aa71-494b-a72b-c978822ca275_del complete
Aug 16 15:07:11 user nova-compute[73091]: INFO nova.compute.manager [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Took 3.37 seconds to destroy the instance on the hypervisor.
Aug 16 15:07:11 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:07:11 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:07:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-40a027eb-d036-4726-964c-7d23c0860191 req-4e7dccdd-ca9c-4736-a602-6ac2ef87ca3c service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-deleted-c5844de6-23b2-4abf-a316-535fa352bd85 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:12 user nova-compute[73091]: INFO nova.compute.manager [req-40a027eb-d036-4726-964c-7d23c0860191 req-4e7dccdd-ca9c-4736-a602-6ac2ef87ca3c service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Neutron deleted interface c5844de6-23b2-4abf-a316-535fa352bd85; detaching it from the instance and deleting it from the info cache
Aug 16 15:07:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-40a027eb-d036-4726-964c-7d23c0860191 req-4e7dccdd-ca9c-4736-a602-6ac2ef87ca3c service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "address": "fa:16:3e:c8:24:52", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe301652-4c", "ovs_interfaceid": "fe301652-4ccd-4986-8597-b65c7dacf3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-40a027eb-d036-4726-964c-7d23c0860191 req-4e7dccdd-ca9c-4736-a602-6ac2ef87ca3c service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Detach interface failed, port_id=c5844de6-23b2-4abf-a316-535fa352bd85, reason: Instance 416d4daf-aa71-494b-a72b-c978822ca275 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:07:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-deleted-fe301652-4ccd-4986-8597-b65c7dacf3f5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:14 user nova-compute[73091]: INFO nova.compute.manager [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Neutron deleted interface fe301652-4ccd-4986-8597-b65c7dacf3f5; detaching it from the instance and deleting it from the info cache
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "address": "fa:16:3e:47:45:c7", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb95bba2-1e", "ovs_interfaceid": "eb95bba2-1e51-40f4-82dd-49a50b4588ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Detach interface failed, port_id=fe301652-4ccd-4986-8597-b65c7dacf3f5, reason: Instance 416d4daf-aa71-494b-a72b-c978822ca275 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-deleted-eb95bba2-1e51-40f4-82dd-49a50b4588ac {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:14 user nova-compute[73091]: INFO nova.compute.manager [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Neutron deleted interface eb95bba2-1e51-40f4-82dd-49a50b4588ac; detaching it from the instance and deleting it from the info cache
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [{"id": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "address": "fa:16:3e:fe:ce:1e", "network": {"id": "dd344320-54b6-4661-8402-69c4cb756065", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-282064878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0c68ce-31", "ovs_interfaceid": "ad0c68ce-314a-47c2-8230-aeb2faf65634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "address": "fa:16:3e:b4:48:e0", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cd5df7-dd", "ovs_interfaceid": "47cd5df7-ddde-4bbe-ad46-617c5ba459ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13d18a09-d88c-481f-beb1-4c28608731b4", "address": "fa:16:3e:c6:01:cb", "network": {"id": "8f079a8a-ea6e-4c2c-9434-3475678f257e", "bridge": "br-int", "label": "tempest-device-tagging-net1-153499949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d18a09-d8", "ovs_interfaceid": "13d18a09-d88c-481f-beb1-4c28608731b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03117bbc-2aec-47d2-94e3-1184350ae321", "address": "fa:16:3e:7f:dd:30", "network": {"id": "1be5a8ed-f3a9-4173-8e50-b0247481bcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463164448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e3d3941ef45419db169d1b5ff06514c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03117bbc-2a", "ovs_interfaceid": "03117bbc-2aec-47d2-94e3-1184350ae321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-52893d3c-4c43-4f6d-b2b1-065958c90120 req-5d577cd4-006c-475e-b45d-7e54fec660d6 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Detach interface failed, port_id=eb95bba2-1e51-40f4-82dd-49a50b4588ac, reason: Instance 416d4daf-aa71-494b-a72b-c978822ca275 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Took 4.27 seconds to deallocate network for instance.
Aug 16 15:07:15 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198420.583524, 6f321a3f-b0c8-48f6-8d98-f34e12a3a485 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:07:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] VM Stopped (Lifecycle Event)
Aug 16 15:07:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06344efa-0168-48ed-84ee-7cab48c31921 None None] [instance: 6f321a3f-b0c8-48f6-8d98-f34e12a3a485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:07:15 user nova-compute[73091]: INFO nova.compute.claims [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Claim successful on node user
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:07:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.policy [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58ba771d2c1c4164aac60e2f80ce7e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c654508f7acb4bc2b690668cfe19522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:07:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Creating image(s)
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "/opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "/opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "/opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk 1073741824" returned: 0 in 0.050s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-35f61f8e-a71c-4a1f-903c-7a7c83e289bf req-688acbe2-568e-434a-8c5a-fd16751fba47 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-deleted-ad0c68ce-314a-47c2-8230-aeb2faf65634 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-35f61f8e-a71c-4a1f-903c-7a7c83e289bf req-688acbe2-568e-434a-8c5a-fd16751fba47 service nova] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Received event network-vif-deleted-03117bbc-2aec-47d2-94e3-1184350ae321 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Successfully created port: 424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Cannot resize image /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'migration_context' on Instance uuid 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Ensure instance console log exists: /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Successfully updated port: 424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquired lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:07:17 user nova-compute[73091]: INFO nova.compute.manager [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Took 2.42 seconds to detach 3 volumes for instance.
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updating instance_info_cache with network_info: [{"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Releasing lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Instance network_info: |[{"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Start _get_guest_xml network_info=[{"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:07:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:07:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-322650660',display_name='tempest-VolumesSnapshotTestJSON-instance-322650660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-322650660',id=22,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnlM/NiKb8u2hYEtlLak/Oe4b2SESoJSo3cd3+0U75XPJ+cjcVrMpEK3Ce6/srCuu2ZP4Shh8kyKpDLi9pa/rKxKvm/REyA3+IT6Bin26YwRhCi1pi5p3xJzfnhr5PkiQ==',key_name='tempest-keypair-1192525417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c654508f7acb4bc2b690668cfe19522d',ramdisk_id='',reservation_id='r-hiz5kuy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-903677429',owner_user_name='tempest-VolumesSnapshotTestJSON-903677429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ba771d2c1c4164aac60e2f80ce7e77',uuid=99360337-b6a6-46d0-b65a-b67441b0c4d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converting VIF {"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'pci_devices' on Instance uuid 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:07:18 user nova-compute[73091]:   <uuid>99360337-b6a6-46d0-b65a-b67441b0c4d9</uuid>
Aug 16 15:07:18 user nova-compute[73091]:   <name>instance-00000016</name>
Aug 16 15:07:18 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:07:18 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:07:18 user nova-compute[73091]:   <metadata>
Aug 16 15:07:18 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:07:18 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:07:18 user nova-compute[73091]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-322650660</nova:name>
Aug 16 15:07:18 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:07:18</nova:creationTime>
Aug 16 15:07:18 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:07:18 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:07:18 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:07:18 user nova-compute[73091]:       <nova:owner>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:user uuid="58ba771d2c1c4164aac60e2f80ce7e77">tempest-VolumesSnapshotTestJSON-903677429-project-member</nova:user>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:project uuid="c654508f7acb4bc2b690668cfe19522d">tempest-VolumesSnapshotTestJSON-903677429</nova:project>
Aug 16 15:07:18 user nova-compute[73091]:       </nova:owner>
Aug 16 15:07:18 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:07:18 user nova-compute[73091]:       <nova:ports>
Aug 16 15:07:18 user nova-compute[73091]:         <nova:port uuid="424310e7-89cb-41e8-b921-35d0fed0e52b">
Aug 16 15:07:18 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:07:18 user nova-compute[73091]:         </nova:port>
Aug 16 15:07:18 user nova-compute[73091]:       </nova:ports>
Aug 16 15:07:18 user nova-compute[73091]:     </nova:instance>
Aug 16 15:07:18 user nova-compute[73091]:   </metadata>
Aug 16 15:07:18 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:07:18 user nova-compute[73091]:     <system>
Aug 16 15:07:18 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:07:18 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:07:18 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:07:18 user nova-compute[73091]:       <entry name="serial">99360337-b6a6-46d0-b65a-b67441b0c4d9</entry>
Aug 16 15:07:18 user nova-compute[73091]:       <entry name="uuid">99360337-b6a6-46d0-b65a-b67441b0c4d9</entry>
Aug 16 15:07:18 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:07:18 user nova-compute[73091]:     </system>
Aug 16 15:07:18 user nova-compute[73091]:   </sysinfo>
Aug 16 15:07:18 user nova-compute[73091]:   <os>
Aug 16 15:07:18 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:07:18 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:07:18 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:07:18 user nova-compute[73091]:   </os>
Aug 16 15:07:18 user nova-compute[73091]:   <features>
Aug 16 15:07:18 user nova-compute[73091]:     <acpi/>
Aug 16 15:07:18 user nova-compute[73091]:     <apic/>
Aug 16 15:07:18 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:07:18 user nova-compute[73091]:   </features>
Aug 16 15:07:18 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:07:18 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:07:18 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:07:18 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:07:18 user nova-compute[73091]:   </clock>
Aug 16 15:07:18 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:07:18 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:07:18 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:07:18 user nova-compute[73091]:   </cpu>
Aug 16 15:07:18 user nova-compute[73091]:   <devices>
Aug 16 15:07:18 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:07:18 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:07:18 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk"/>
Aug 16 15:07:18 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:07:18 user nova-compute[73091]:     </disk>
Aug 16 15:07:18 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:07:18 user nova-compute[73091]:       <mac address="fa:16:3e:31:95:b9"/>
Aug 16 15:07:18 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:07:18 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:07:18 user nova-compute[73091]:       <target dev="tap424310e7-89"/>
Aug 16 15:07:18 user nova-compute[73091]:     </interface>
Aug 16 15:07:18 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:07:18 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/console.log" append="off"/>
Aug 16 15:07:18 user nova-compute[73091]:     </serial>
Aug 16 15:07:18 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:07:18 user nova-compute[73091]:     <video>
Aug 16 15:07:18 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:07:18 user nova-compute[73091]:     </video>
Aug 16 15:07:18 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:07:18 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:07:18 user nova-compute[73091]:     </rng>
Aug 16 15:07:18 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:07:18 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:07:18 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:07:18 user nova-compute[73091]:     </memballoon>
Aug 16 15:07:18 user nova-compute[73091]:   </devices>
Aug 16 15:07:18 user nova-compute[73091]: </domain>
Aug 16 15:07:18 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-322650660',display_name='tempest-VolumesSnapshotTestJSON-instance-322650660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-322650660',id=22,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnlM/NiKb8u2hYEtlLak/Oe4b2SESoJSo3cd3+0U75XPJ+cjcVrMpEK3Ce6/srCuu2ZP4Shh8kyKpDLi9pa/rKxKvm/REyA3+IT6Bin26YwRhCi1pi5p3xJzfnhr5PkiQ==',key_name='tempest-keypair-1192525417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c654508f7acb4bc2b690668cfe19522d',ramdisk_id='',reservation_id='r-hiz5kuy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-903677429',owner_user_name='tempest-VolumesSnapshotTestJSON-903677429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ba771d2c1c4164aac60e2f80ce7e77',uuid=99360337-b6a6-46d0-b65a-b67441b0c4d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converting VIF {"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG os_vif [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap424310e7-89, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap424310e7-89, col_values=(('external_ids', {'iface-id': '424310e7-89cb-41e8-b921-35d0fed0e52b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:95:b9', 'vm-uuid': '99360337-b6a6-46d0-b65a-b67441b0c4d9'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:18 user nova-compute[73091]: INFO os_vif [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89')
Aug 16 15:07:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No VIF found with MAC fa:16:3e:31:95:b9, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:07:18 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Deleted allocations for instance 416d4daf-aa71-494b-a72b-c978822ca275
Aug 16 15:07:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f67a0351-94b6-40c8-ad4f-67f017f3f203 tempest-TaggedBootDevicesTest-1454900072 tempest-TaggedBootDevicesTest-1454900072-project-member] Lock "416d4daf-aa71-494b-a72b-c978822ca275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.841s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-changed-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Refreshing instance network info cache due to event network-changed-424310e7-89cb-41e8-b921-35d0fed0e52b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] Acquiring lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] Acquired lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:07:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Refreshing network info cache for port 424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:07:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updated VIF entry in instance network info cache for port 424310e7-89cb-41e8-b921-35d0fed0e52b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:07:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updating instance_info_cache with network_info: [{"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aaaec8ed-9e67-4608-bc24-4ff7beca6334 req-f51aa5a4-67b9-42ff-b0f1-d7910fe77985 service nova] Releasing lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:07:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] No waiting events found dispatching network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:21 user nova-compute[73091]: WARNING nova.compute.manager [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received unexpected event network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b for instance with vm_state building and task_state spawning.
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] No waiting events found dispatching network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:21 user nova-compute[73091]: WARNING nova.compute.manager [req-7ecb7966-bbdf-4dca-b28d-c83c731082da req-079570c8-311e-40f6-8957-f1f9adcf386d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received unexpected event network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b for instance with vm_state building and task_state spawning.
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198441.9052875, 99360337-b6a6-46d0-b65a-b67441b0c4d9 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:07:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] VM Resumed (Lifecycle Event)
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:07:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Instance spawned successfully.
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:07:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198441.9066617, 99360337-b6a6-46d0-b65a-b67441b0c4d9 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:07:21 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] VM Started (Lifecycle Event)
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:07:22 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:07:22 user nova-compute[73091]: INFO nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 16 15:07:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:22 user nova-compute[73091]: INFO nova.compute.manager [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Took 6.38 seconds to build instance.
Aug 16 15:07:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01f14be5-4069-4674-8893-e179bfeb62b8 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.465s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:24 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198429.67753, 416d4daf-aa71-494b-a72b-c978822ca275 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:07:24 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] VM Stopped (Lifecycle Event)
Aug 16 15:07:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa2e65b6-cc95-4bce-92ca-f65dc7e49d68 None None] [instance: 416d4daf-aa71-494b-a72b-c978822ca275] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:07:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:46 user nova-compute[73091]: INFO nova.compute.manager [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Terminating instance
Aug 16 15:07:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-05d39efc-28d0-4c2e-90a1-0104500dc6b3 req-34b9e975-56e8-4722-bb71-14212875d601 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-unplugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05d39efc-28d0-4c2e-90a1-0104500dc6b3 req-34b9e975-56e8-4722-bb71-14212875d601 service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05d39efc-28d0-4c2e-90a1-0104500dc6b3 req-34b9e975-56e8-4722-bb71-14212875d601 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05d39efc-28d0-4c2e-90a1-0104500dc6b3 req-34b9e975-56e8-4722-bb71-14212875d601 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-05d39efc-28d0-4c2e-90a1-0104500dc6b3 req-34b9e975-56e8-4722-bb71-14212875d601 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-unplugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-05d39efc-28d0-4c2e-90a1-0104500dc6b3 req-34b9e975-56e8-4722-bb71-14212875d601 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-unplugged-87877225-4724-4450-86a5-8bc5484ad81f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:07:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Instance destroyed successfully.
Aug 16 15:07:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lazy-loading 'resources' on Instance uuid 8d7711c7-b746-4965-af37-1a9b439c7435 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T15:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1035689665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1035689665',id=18,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx2fiAUpVjTJSfvHG32eoP0l/V3x1+M+elADP38wBa1pofyUG3uYhcURiBI7zXRL8KX8qABeYnI48V0mNYu9Wbk3NACUyhy2PLZjLNlsIkGdO9hbSJgTbugWBKzhiGtbA==',key_name='tempest-keypair-866831337',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df79780a126247e3afc48a27aed45371',ramdisk_id='',reservation_id='r-9j479nb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-772280576',owner_user_name='tempest-TaggedAttachmentsTest-772280576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb68f9de4034c3386d7ccb8333c6f45',uuid=8d7711c7-b746-4965-af37-1a9b439c7435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converting VIF {"id": "87877225-4724-4450-86a5-8bc5484ad81f", "address": "fa:16:3e:48:1b:e7", "network": {"id": "355dd317-576c-4948-8beb-836c744a467d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2110968301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df79780a126247e3afc48a27aed45371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877225-47", "ovs_interfaceid": "87877225-4724-4450-86a5-8bc5484ad81f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG os_vif [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87877225-47, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:07:47 user nova-compute[73091]: INFO os_vif [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:1b:e7,bridge_name='br-int',has_traffic_filtering=True,id=87877225-4724-4450-86a5-8bc5484ad81f,network=Network(355dd317-576c-4948-8beb-836c744a467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877225-47')
Aug 16 15:07:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Deleting instance files /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435_del
Aug 16 15:07:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Deletion of /opt/stack/data/nova/instances/8d7711c7-b746-4965-af37-1a9b439c7435_del complete
Aug 16 15:07:47 user nova-compute[73091]: INFO nova.compute.manager [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 15:07:47 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:07:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:07:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Took 0.78 seconds to deallocate network for instance.
Aug 16 15:07:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c55945c-9351-4c81-ab20-ab21fdc2f80b req-542f3054-579a-42ca-b8d4-269ec9a417a8 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-deleted-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:48 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Deleted allocations for instance 8d7711c7-b746-4965-af37-1a9b439c7435
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5e008974-7a62-4843-8ea8-d949bc5efdaa tempest-TaggedAttachmentsTest-772280576 tempest-TaggedAttachmentsTest-772280576-project-member] Lock "8d7711c7-b746-4965-af37-1a9b439c7435" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-80e36e9e-7b65-4136-806b-30bcfc550249 req-4e6236cd-6386-47a3-bfae-6c26313ed352 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received event network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80e36e9e-7b65-4136-806b-30bcfc550249 req-4e6236cd-6386-47a3-bfae-6c26313ed352 service nova] Acquiring lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80e36e9e-7b65-4136-806b-30bcfc550249 req-4e6236cd-6386-47a3-bfae-6c26313ed352 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80e36e9e-7b65-4136-806b-30bcfc550249 req-4e6236cd-6386-47a3-bfae-6c26313ed352 service nova] Lock "8d7711c7-b746-4965-af37-1a9b439c7435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:07:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-80e36e9e-7b65-4136-806b-30bcfc550249 req-4e6236cd-6386-47a3-bfae-6c26313ed352 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] No waiting events found dispatching network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:07:48 user nova-compute[73091]: WARNING nova.compute.manager [req-80e36e9e-7b65-4136-806b-30bcfc550249 req-4e6236cd-6386-47a3-bfae-6c26313ed352 service nova] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Received unexpected event network-vif-plugged-87877225-4724-4450-86a5-8bc5484ad81f for instance with vm_state deleted and task_state None.
Aug 16 15:07:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:07:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-changed-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Refreshing instance network info cache due to event network-changed-bf56269d-0e3e-4ece-98a3-8802f8a708d5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] Acquiring lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] Acquired lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Refreshing network info cache for port bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198467.1936405, 8d7711c7-b746-4965-af37-1a9b439c7435 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] VM Stopped (Lifecycle Event)
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updated VIF entry in instance network info cache for port bf56269d-0e3e-4ece-98a3-8802f8a708d5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updating instance_info_cache with network_info: [{"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4e2be405-8203-49c5-b2f9-b9485ce9c384 None None] [instance: 8d7711c7-b746-4965-af37-1a9b439c7435] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96ef64ed-1ee4-46ea-a34c-540fd6566910 req-3e949cba-bfcf-4385-8a99-f2404f63d479 service nova] Releasing lock "refresh_cache-3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:02 user nova-compute[73091]: INFO nova.compute.manager [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Rebuilding instance
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'pci_requests' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'resources' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'migration_context' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-0dfd70ca-0f27-48bc-b43a-631b864b352e req-97b98500-52c9-4cb0-8ed2-780d46f19a3a service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-unplugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0dfd70ca-0f27-48bc-b43a-631b864b352e req-97b98500-52c9-4cb0-8ed2-780d46f19a3a service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0dfd70ca-0f27-48bc-b43a-631b864b352e req-97b98500-52c9-4cb0-8ed2-780d46f19a3a service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0dfd70ca-0f27-48bc-b43a-631b864b352e req-97b98500-52c9-4cb0-8ed2-780d46f19a3a service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-0dfd70ca-0f27-48bc-b43a-631b864b352e req-97b98500-52c9-4cb0-8ed2-780d46f19a3a service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-unplugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:03 user nova-compute[73091]: WARNING nova.compute.manager [req-0dfd70ca-0f27-48bc-b43a-631b864b352e req-97b98500-52c9-4cb0-8ed2-780d46f19a3a service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-unplugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state active and task_state rebuilding.
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance destroyed successfully.
Aug 16 15:08:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance destroyed successfully.
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-346040655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530517513',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpDK9diB/iGHmTw8zyI03BPzG0gmt19AjpasgRrC2AapJW9WduN0Sn1X12aXf3NAEQELnrpLB54g7QBcvHqnGSsePaPoddcVudgK9ELiSOj78jb5LBn41UHFf62ExadLw==',key_name='tempest-keypair-1560473014',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc86a892945c4fae9e5187741b6cb65c',ramdisk_id='',reservation_id='r-dctyxscq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725797811',owner_user_name='tempest-ServerActionsV293TestJSON-725797811-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d227888e574b1ba4c8849fe85282a5',uuid=3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converting VIF {"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG os_vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf56269d-0e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:03 user nova-compute[73091]: INFO os_vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e')
Aug 16 15:08:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:08:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:08:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e73fb-c038-4093-ba02-19d613879c23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051525c-820e-4afa-90f9-7f88dc8e92e2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:04 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:08:04 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:04 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:08:04 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1154251900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[489397c0-a08b-40ec-8f6b-a92a1694715a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc239da-c806-4811-9324-e1010d4ffcf7]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e327b7-3cb0-42d6-9f11-904337b0bebf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50a81d-aa5d-48f8-bdc3-0c561746cb6c]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a1da437', '/dev/disk/by-id/scsi-23834613762303234', '/dev/disk/by-id/scsi-1SCST_BIO9a1da437-84a7b02480688258') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58babe3-3480-4651-92f2-1ad53e69b96b]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cd0dc3-954d-424b-bb93-c9d5b9784a20]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c9196e-206c-4b28-9144-a5b8293ac325]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]
Aug 16 15:08:04 user nova-compute[73091]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.
Aug 16 15:08:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306acf5-46de-4d39-a243-4e7203548156]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== disconnect_volume: return (348ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:08:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Deleting instance files /opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c_del
Aug 16 15:08:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Deletion of /opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c_del complete
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c could not be found.
Aug 16 15:08:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:08:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8329928-5440-4267-a185-f961a373e9d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866fb6a-35dd-4166-9f0a-d6ed58a12ae8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:04 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:04 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c54a680>, {}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== disconnect_volume: return (60ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:08:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-968ceb6e-390e-4331-946e-67d7e2294e6a req-fd8f7a2f-afb2-43eb-a4ee-1481e98ae6c0 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-968ceb6e-390e-4331-946e-67d7e2294e6a req-fd8f7a2f-afb2-43eb-a4ee-1481e98ae6c0 service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-968ceb6e-390e-4331-946e-67d7e2294e6a req-fd8f7a2f-afb2-43eb-a4ee-1481e98ae6c0 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-968ceb6e-390e-4331-946e-67d7e2294e6a req-fd8f7a2f-afb2-43eb-a4ee-1481e98ae6c0 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-968ceb6e-390e-4331-946e-67d7e2294e6a req-fd8f7a2f-afb2-43eb-a4ee-1481e98ae6c0 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:05 user nova-compute[73091]: WARNING nova.compute.manager [req-968ceb6e-390e-4331-946e-67d7e2294e6a req-fd8f7a2f-afb2-43eb-a4ee-1481e98ae6c0 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state active and task_state rebuilding.
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Preparing to wait for external event volume-reimaged-e9dd3520-e6ca-4515-8bd3-66858bb93721 {{(pid=73091) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:08:06 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:06 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7120MB free_disk=25.52056884765625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updating instance_info_cache with network_info: [{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing instance network info cache due to event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updated VIF entry in instance network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b0a62725-650e-4bb4-be6d-ac465798e469 req-7dbf792e-d4a3-44aa-a9b3-c2338d8463ac service nova] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:18 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198483.8352501, 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:18 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] VM Stopped (Lifecycle Event)
Aug 16 15:08:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-33723d34-0cb4-4fb6-8fa2-77c0d0dbaee8 None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:22 user nova-compute[73091]: INFO nova.compute.manager [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Shelving
Aug 16 15:08:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f5f50f6-47ee-4c72-95e7-055aa39572a8 req-9c2fbb2d-3ef9-42f0-9b1c-99f46a0ec52d service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-unplugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f5f50f6-47ee-4c72-95e7-055aa39572a8 req-9c2fbb2d-3ef9-42f0-9b1c-99f46a0ec52d service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f5f50f6-47ee-4c72-95e7-055aa39572a8 req-9c2fbb2d-3ef9-42f0-9b1c-99f46a0ec52d service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f5f50f6-47ee-4c72-95e7-055aa39572a8 req-9c2fbb2d-3ef9-42f0-9b1c-99f46a0ec52d service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f5f50f6-47ee-4c72-95e7-055aa39572a8 req-9c2fbb2d-3ef9-42f0-9b1c-99f46a0ec52d service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-unplugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:22 user nova-compute[73091]: WARNING nova.compute.manager [req-0f5f50f6-47ee-4c72-95e7-055aa39572a8 req-9c2fbb2d-3ef9-42f0-9b1c-99f46a0ec52d service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-unplugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state active and task_state shelving.
Aug 16 15:08:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance destroyed successfully.
Aug 16 15:08:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Beginning cold snapshot process
Aug 16 15:08:23 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:08:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk /opt/stack/data/nova/instances/snapshots/tmpvowz3qmd/0c0769d16eca4f50b8989e176ef5ce7f {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk /opt/stack/data/nova/instances/snapshots/tmpvowz3qmd/0c0769d16eca4f50b8989e176ef5ce7f" returned: 0 in 1.449s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Snapshot extracted, beginning image upload
Aug 16 15:08:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-695a617a-83e3-4944-a88c-e3e14cafc5ed req-6a227313-88b6-41a3-b7d1-779e5227f78b service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-695a617a-83e3-4944-a88c-e3e14cafc5ed req-6a227313-88b6-41a3-b7d1-779e5227f78b service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-695a617a-83e3-4944-a88c-e3e14cafc5ed req-6a227313-88b6-41a3-b7d1-779e5227f78b service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-695a617a-83e3-4944-a88c-e3e14cafc5ed req-6a227313-88b6-41a3-b7d1-779e5227f78b service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-695a617a-83e3-4944-a88c-e3e14cafc5ed req-6a227313-88b6-41a3-b7d1-779e5227f78b service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:25 user nova-compute[73091]: WARNING nova.compute.manager [req-695a617a-83e3-4944-a88c-e3e14cafc5ed req-6a227313-88b6-41a3-b7d1-779e5227f78b service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 15:08:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Snapshot image upload complete
Aug 16 15:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:27 user nova-compute[73091]: INFO nova.compute.manager [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Shelve offloading
Aug 16 15:08:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance destroyed successfully.
Aug 16 15:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a req-7893856b-462a-43f9-9c50-f1639b62f50f service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event volume-reimaged-e9dd3520-e6ca-4515-8bd3-66858bb93721 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a req-7893856b-462a-43f9-9c50-f1639b62f50f service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a req-7893856b-462a-43f9-9c50-f1639b62f50f service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a req-7893856b-462a-43f9-9c50-f1639b62f50f service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a req-7893856b-462a-43f9-9c50-f1639b62f50f service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Processing event volume-reimaged-e9dd3520-e6ca-4515-8bd3-66858bb93721 {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:08:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Booting with volume e9dd3520-e6ca-4515-8bd3-66858bb93721 at /dev/vda
Aug 16 15:08:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e8f50e-2284-4614-8e74-cc7e689d74af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efe10ef-eda6-48ad-860d-4ab3ad468af4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bc7b50-15fa-45c8-9fb3-1ab8dbc7b2a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf6a45-b1dd-424f-9a15-cd2115ab81b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:08:28 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:08:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f402e99f-b650-4e1d-add7-2b2e9c15ec0b]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updating existing volume attachment record: 5014ec16-09b5-47eb-be74-605880ad5691 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:08:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance destroyed successfully.
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'resources' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1432407467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1432407467',id=20,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTdrq52bxwbvCCopZobtCA9IYWKP27UTtYnxFo42/vyruNRnyGf54dmJu8XN2YyXoyW3Zbb6a+qSPV31CAPz2dj0p04rQwXfuvkr5u9sNDyI9Z9wnB11+4LRJp34x5AOg==',key_name='tempest-keypair-1998158073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-1lqullfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member',shelved_at='2023-08-16T15:08:27.499378',shelved_host='user',shelved_image_id='775551e7-f243-4304-934d-b40d1268022b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=8263a95b-fe6a-45c8-a94e-dccd6ec5f623,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG os_vif [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63bacab4-37, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:29 user nova-compute[73091]: INFO os_vif [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37')
Aug 16 15:08:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Deleting instance files /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623_del
Aug 16 15:08:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Deletion of /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623_del complete
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing instance network info cache due to event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:08:29 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Deleted allocations for instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623
Aug 16 15:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'numa_topology' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6f952e6-1a61-4651-9a50-9754f87410a4 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.483s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updated VIF entry in instance network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:08:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap63bacab4-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9e685cf6-246f-44fc-ab0b-cbef29b2fd88 req-e622f3b1-c498-49de-adb8-488bf3439003 service nova] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:37 user nova-compute[73091]: INFO nova.compute.manager [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Terminating instance
Aug 16 15:08:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198503.0676396, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:38 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] VM Stopped (Lifecycle Event)
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6aa59700-2939-43b2-a980-f7f29a85902d None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-e78e7aa8-8543-4358-8121-f50d4235e9c5 req-6e0caac9-8221-48fe-9042-c3c9c829fecf service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-vif-unplugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e78e7aa8-8543-4358-8121-f50d4235e9c5 req-6e0caac9-8221-48fe-9042-c3c9c829fecf service nova] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e78e7aa8-8543-4358-8121-f50d4235e9c5 req-6e0caac9-8221-48fe-9042-c3c9c829fecf service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e78e7aa8-8543-4358-8121-f50d4235e9c5 req-6e0caac9-8221-48fe-9042-c3c9c829fecf service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-e78e7aa8-8543-4358-8121-f50d4235e9c5 req-6e0caac9-8221-48fe-9042-c3c9c829fecf service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] No waiting events found dispatching network-vif-unplugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-e78e7aa8-8543-4358-8121-f50d4235e9c5 req-6e0caac9-8221-48fe-9042-c3c9c829fecf service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-vif-unplugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:08:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Instance destroyed successfully.
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lazy-loading 'resources' on Instance uuid 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-634442717',display_name='tempest-VolumesActionsTest-instance-634442717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-634442717',id=21,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eecf18330f0441985585318dd8edf13',ramdisk_id='',reservation_id='r-3t47iuek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1670917556',owner_user_name='tempest-VolumesActionsTest-1670917556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:06:57Z,user_data=None,user_id='a9e2d700270c444dbd589941e320cb00',uuid=693b6f64-f23b-438a-8aa6-97f2ed7f9b7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converting VIF {"id": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "address": "fa:16:3e:1c:43:2c", "network": {"id": "702d484d-8a83-4915-a7bb-c8cf02cdc11b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1817832149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eecf18330f0441985585318dd8edf13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb38fde-d7", "ovs_interfaceid": "2eb38fde-d792-4d81-bc9c-b4953c1048e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG os_vif [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb38fde-d7, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:38 user nova-compute[73091]: INFO os_vif [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:2c,bridge_name='br-int',has_traffic_filtering=True,id=2eb38fde-d792-4d81-bc9c-b4953c1048e8,network=Network(702d484d-8a83-4915-a7bb-c8cf02cdc11b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb38fde-d7')
Aug 16 15:08:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Deleting instance files /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c_del
Aug 16 15:08:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Deletion of /opt/stack/data/nova/instances/693b6f64-f23b-438a-8aa6-97f2ed7f9b7c_del complete
Aug 16 15:08:38 user nova-compute[73091]: INFO nova.compute.manager [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 15:08:38 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:08:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Creating image(s)
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Start _get_guest_xml network_info=[{"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '5014ec16-09b5-47eb-be74-605880ad5691', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9dd3520-e6ca-4515-8bd3-66858bb93721', 'serial': 'e9dd3520-e6ca-4515-8bd3-66858bb93721'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:08:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 15:08:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:08:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:08:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:08:39 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[62102b34-babf-42e5-8d09-2a9ba75bce47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:08:39 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2037109-9948-4574-86d7-a2648a3ea28f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721] added
Aug 16 15:08:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a007e2-0135-4fe6-8a33-cb0289fa37de]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-2a6d16fb-373d-4843-bd66-87110a07a88b req-0e205815-8402-4a25-a7b1-eff4190743d4 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-vif-deleted-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:39 user nova-compute[73091]: INFO nova.compute.manager [req-2a6d16fb-373d-4843-bd66-87110a07a88b req-0e205815-8402-4a25-a7b1-eff4190743d4 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Neutron deleted interface 2eb38fde-d792-4d81-bc9c-b4953c1048e8; detaching it from the instance and deleting it from the info cache
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-2a6d16fb-373d-4843-bd66-87110a07a88b req-0e205815-8402-4a25-a7b1-eff4190743d4 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:39 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Took 1.09 seconds to deallocate network for instance.
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21433d83-80f5-4861-a3ed-e4fc16a40660]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxQpUWTR {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-2a6d16fb-373d-4843-bd66-87110a07a88b req-0e205815-8402-4a25-a7b1-eff4190743d4 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Detach interface failed, port_id=2eb38fde-d792-4d81-bc9c-b4953c1048e8, reason: Instance 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxQpUWTR" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad4f4a7-bdff-4a1e-9716-51642e7f4150]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KxQpUWTR'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928907c-53ba-457a-9d28-0c4db2a9eaf5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0612f139-407d-46dc-8145-3d95ecae23a9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:39 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:39 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea926030-fd49-43d0-98a5-db7d41097c63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]
Aug 16 15:08:39 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.
Aug 16 15:08:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83a1fe-0efb-4c3d-9716-6b8f92c3b210]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaafb4f-e781-421e-abe8-166fd26b3af7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:39 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:39 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:08:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:08:39 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:08:39 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:08:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8992b1-bc3a-4e59-8116-fa689e66f59a]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-f254728e-1a03-4838-8b63-457cb49260ac req-7a1340f9-d525-4541-a7c1-c92e546fab11 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received event network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f254728e-1a03-4838-8b63-457cb49260ac req-7a1340f9-d525-4541-a7c1-c92e546fab11 service nova] Acquiring lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f254728e-1a03-4838-8b63-457cb49260ac req-7a1340f9-d525-4541-a7c1-c92e546fab11 service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f254728e-1a03-4838-8b63-457cb49260ac req-7a1340f9-d525-4541-a7c1-c92e546fab11 service nova] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-f254728e-1a03-4838-8b63-457cb49260ac req-7a1340f9-d525-4541-a7c1-c92e546fab11 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] No waiting events found dispatching network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:40 user nova-compute[73091]: WARNING nova.compute.manager [req-f254728e-1a03-4838-8b63-457cb49260ac req-7a1340f9-d525-4541-a7c1-c92e546fab11 service nova] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Received unexpected event network-vif-plugged-2eb38fde-d792-4d81-bc9c-b4953c1048e8 for instance with vm_state deleted and task_state None.
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:40 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Deleted allocations for instance 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c
Aug 16 15:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adb69cf5-bb4a-4533-a18e-9e93f2839341 tempest-VolumesActionsTest-1670917556 tempest-VolumesActionsTest-1670917556-project-member] Lock "693b6f64-f23b-438a-8aa6-97f2ed7f9b7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.667s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23834613762303234', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834613762303234', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-346040655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530517513',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpDK9diB/iGHmTw8zyI03BPzG0gmt19AjpasgRrC2AapJW9WduN0Sn1X12aXf3NAEQELnrpLB54g7QBcvHqnGSsePaPoddcVudgK9ELiSOj78jb5LBn41UHFf62ExadLw==',key_name='tempest-keypair-1560473014',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc86a892945c4fae9e5187741b6cb65c',ramdisk_id='',reservation_id='r-dctyxscq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725797811',owner_user_name='tempest-ServerActionsV293TestJSON-725797811-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d227888e574b1ba4c8849fe85282a5',uuid=3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converting VIF {"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:08:41 user nova-compute[73091]:   <uuid>3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c</uuid>
Aug 16 15:08:41 user nova-compute[73091]:   <name>instance-00000013</name>
Aug 16 15:08:41 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:08:41 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:08:41 user nova-compute[73091]:   <metadata>
Aug 16 15:08:41 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:08:41 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:08:41 user nova-compute[73091]:       <nova:name>tempest-ServerActionsV293TestJSON-server-346040655</nova:name>
Aug 16 15:08:41 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:08:39</nova:creationTime>
Aug 16 15:08:41 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:08:41 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:08:41 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:08:41 user nova-compute[73091]:       <nova:owner>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:user uuid="27d227888e574b1ba4c8849fe85282a5">tempest-ServerActionsV293TestJSON-725797811-project-member</nova:user>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:project uuid="bc86a892945c4fae9e5187741b6cb65c">tempest-ServerActionsV293TestJSON-725797811</nova:project>
Aug 16 15:08:41 user nova-compute[73091]:       </nova:owner>
Aug 16 15:08:41 user nova-compute[73091]:       <nova:ports>
Aug 16 15:08:41 user nova-compute[73091]:         <nova:port uuid="bf56269d-0e3e-4ece-98a3-8802f8a708d5">
Aug 16 15:08:41 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 15:08:41 user nova-compute[73091]:         </nova:port>
Aug 16 15:08:41 user nova-compute[73091]:       </nova:ports>
Aug 16 15:08:41 user nova-compute[73091]:     </nova:instance>
Aug 16 15:08:41 user nova-compute[73091]:   </metadata>
Aug 16 15:08:41 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:08:41 user nova-compute[73091]:     <system>
Aug 16 15:08:41 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:08:41 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:08:41 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:08:41 user nova-compute[73091]:       <entry name="serial">3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c</entry>
Aug 16 15:08:41 user nova-compute[73091]:       <entry name="uuid">3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c</entry>
Aug 16 15:08:41 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:08:41 user nova-compute[73091]:     </system>
Aug 16 15:08:41 user nova-compute[73091]:   </sysinfo>
Aug 16 15:08:41 user nova-compute[73091]:   <os>
Aug 16 15:08:41 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:08:41 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:08:41 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:08:41 user nova-compute[73091]:   </os>
Aug 16 15:08:41 user nova-compute[73091]:   <features>
Aug 16 15:08:41 user nova-compute[73091]:     <acpi/>
Aug 16 15:08:41 user nova-compute[73091]:     <apic/>
Aug 16 15:08:41 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:08:41 user nova-compute[73091]:   </features>
Aug 16 15:08:41 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:08:41 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:08:41 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:08:41 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:08:41 user nova-compute[73091]:   </clock>
Aug 16 15:08:41 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:08:41 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:08:41 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:08:41 user nova-compute[73091]:   </cpu>
Aug 16 15:08:41 user nova-compute[73091]:   <devices>
Aug 16 15:08:41 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:08:41 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:08:41 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:08:41 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:08:41 user nova-compute[73091]:       <serial>e9dd3520-e6ca-4515-8bd3-66858bb93721</serial>
Aug 16 15:08:41 user nova-compute[73091]:     </disk>
Aug 16 15:08:41 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:08:41 user nova-compute[73091]:       <mac address="fa:16:3e:2a:9b:29"/>
Aug 16 15:08:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:41 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:08:41 user nova-compute[73091]:       <target dev="tapbf56269d-0e"/>
Aug 16 15:08:41 user nova-compute[73091]:     </interface>
Aug 16 15:08:41 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:08:41 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c/console.log" append="off"/>
Aug 16 15:08:41 user nova-compute[73091]:     </serial>
Aug 16 15:08:41 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:08:41 user nova-compute[73091]:     <video>
Aug 16 15:08:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:41 user nova-compute[73091]:     </video>
Aug 16 15:08:41 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:08:41 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:08:41 user nova-compute[73091]:     </rng>
Aug 16 15:08:41 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:08:41 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:08:41 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:08:41 user nova-compute[73091]:     </memballoon>
Aug 16 15:08:41 user nova-compute[73091]:   </devices>
Aug 16 15:08:41 user nova-compute[73091]: </domain>
Aug 16 15:08:41 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-346040655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530517513',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpDK9diB/iGHmTw8zyI03BPzG0gmt19AjpasgRrC2AapJW9WduN0Sn1X12aXf3NAEQELnrpLB54g7QBcvHqnGSsePaPoddcVudgK9ELiSOj78jb5LBn41UHFf62ExadLw==',key_name='tempest-keypair-1560473014',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc86a892945c4fae9e5187741b6cb65c',ramdisk_id='',reservation_id='r-dctyxscq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725797811',owner_user_name='tempest-ServerActionsV293TestJSON-725797811-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d227888e574b1ba4c8849fe85282a5',uuid=3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converting VIF {"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG os_vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf56269d-0e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf56269d-0e, col_values=(('external_ids', {'iface-id': 'bf56269d-0e3e-4ece-98a3-8802f8a708d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:9b:29', 'vm-uuid': '3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:41 user nova-compute[73091]: INFO os_vif [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e')
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] No VIF found with MAC fa:16:3e:2a:9b:29, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-6de8b215-c897-44a4-9018-bf791e08f70f req-0217d4e9-6e2e-4593-bf56-4202731a2b38 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6de8b215-c897-44a4-9018-bf791e08f70f req-0217d4e9-6e2e-4593-bf56-4202731a2b38 service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6de8b215-c897-44a4-9018-bf791e08f70f req-0217d4e9-6e2e-4593-bf56-4202731a2b38 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6de8b215-c897-44a4-9018-bf791e08f70f req-0217d4e9-6e2e-4593-bf56-4202731a2b38 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-6de8b215-c897-44a4-9018-bf791e08f70f req-0217d4e9-6e2e-4593-bf56-4202731a2b38 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:42 user nova-compute[73091]: WARNING nova.compute.manager [req-6de8b215-c897-44a4-9018-bf791e08f70f req-0217d4e9-6e2e-4593-bf56-4202731a2b38 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 15:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198524.7927742, 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] VM Resumed (Lifecycle Event)
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:08:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance spawned successfully.
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198524.795573, 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] VM Started (Lifecycle Event)
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 15:08:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:08:44 user nova-compute[73091]: INFO nova.compute.claims [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Claim successful on node user
Aug 16 15:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d8de422-8be1-4db8-8c60-6a5500662651 req-e598ed33-f89f-48ea-8855-0724a88b117c service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d8de422-8be1-4db8-8c60-6a5500662651 req-e598ed33-f89f-48ea-8855-0724a88b117c service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d8de422-8be1-4db8-8c60-6a5500662651 req-e598ed33-f89f-48ea-8855-0724a88b117c service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d8de422-8be1-4db8-8c60-6a5500662651 req-e598ed33-f89f-48ea-8855-0724a88b117c service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d8de422-8be1-4db8-8c60-6a5500662651 req-e598ed33-f89f-48ea-8855-0724a88b117c service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:45 user nova-compute[73091]: WARNING nova.compute.manager [req-8d8de422-8be1-4db8-8c60-6a5500662651 req-e598ed33-f89f-48ea-8855-0724a88b117c service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state active and task_state None.
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.408s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fbca239-f4ac-4dc8-8a37-220a88f3dd7a tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.policy [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74c79b9ea11c4d108e57a04ed7052cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca74df5f6c3643879a985989a478d33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:08:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Creating image(s)
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk 1073741824" returned: 0 in 0.069s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Cannot resize image /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'migration_context' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Ensure instance console log exists: /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Successfully created port: f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:08:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:08:48 user nova-compute[73091]: INFO nova.compute.claims [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Claim successful on node user
Aug 16 15:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Successfully updated port: f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-changed-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Refreshing instance network info cache due to event network-changed-f94a19b5-a285-4efb-9931-8f26831a7382. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:08:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:08:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.policy [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0243ed66e484f6a820421b1f69ece02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4d07f3079144a59f93086e00017115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:08:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Creating image(s)
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance network_info: |[{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Refreshing network info cache for port f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start _get_guest_xml network_info=[{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:08:49 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:49 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'pci_devices' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:08:49 user nova-compute[73091]:   <uuid>a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</uuid>
Aug 16 15:08:49 user nova-compute[73091]:   <name>instance-00000017</name>
Aug 16 15:08:49 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:08:49 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:08:49 user nova-compute[73091]:   <metadata>
Aug 16 15:08:49 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:08:49 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:08:49 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-511399511</nova:name>
Aug 16 15:08:49 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:08:49</nova:creationTime>
Aug 16 15:08:49 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:08:49 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:08:49 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:08:49 user nova-compute[73091]:       <nova:owner>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:user uuid="74c79b9ea11c4d108e57a04ed7052cd4">tempest-ServerActionsTestOtherB-2002245511-project-member</nova:user>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:project uuid="ca74df5f6c3643879a985989a478d33a">tempest-ServerActionsTestOtherB-2002245511</nova:project>
Aug 16 15:08:49 user nova-compute[73091]:       </nova:owner>
Aug 16 15:08:49 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:08:49 user nova-compute[73091]:       <nova:ports>
Aug 16 15:08:49 user nova-compute[73091]:         <nova:port uuid="f94a19b5-a285-4efb-9931-8f26831a7382">
Aug 16 15:08:49 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:08:49 user nova-compute[73091]:         </nova:port>
Aug 16 15:08:49 user nova-compute[73091]:       </nova:ports>
Aug 16 15:08:49 user nova-compute[73091]:     </nova:instance>
Aug 16 15:08:49 user nova-compute[73091]:   </metadata>
Aug 16 15:08:49 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:08:49 user nova-compute[73091]:     <system>
Aug 16 15:08:49 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:08:49 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:08:49 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:08:49 user nova-compute[73091]:       <entry name="serial">a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</entry>
Aug 16 15:08:49 user nova-compute[73091]:       <entry name="uuid">a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</entry>
Aug 16 15:08:49 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:08:49 user nova-compute[73091]:     </system>
Aug 16 15:08:49 user nova-compute[73091]:   </sysinfo>
Aug 16 15:08:49 user nova-compute[73091]:   <os>
Aug 16 15:08:49 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:08:49 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:08:49 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:08:49 user nova-compute[73091]:   </os>
Aug 16 15:08:49 user nova-compute[73091]:   <features>
Aug 16 15:08:49 user nova-compute[73091]:     <acpi/>
Aug 16 15:08:49 user nova-compute[73091]:     <apic/>
Aug 16 15:08:49 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:08:49 user nova-compute[73091]:   </features>
Aug 16 15:08:49 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:08:49 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:08:49 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:08:49 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:08:49 user nova-compute[73091]:   </clock>
Aug 16 15:08:49 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:08:49 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:08:49 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:08:49 user nova-compute[73091]:   </cpu>
Aug 16 15:08:49 user nova-compute[73091]:   <devices>
Aug 16 15:08:49 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:08:49 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:08:49 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk"/>
Aug 16 15:08:49 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:08:49 user nova-compute[73091]:     </disk>
Aug 16 15:08:49 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:08:49 user nova-compute[73091]:       <mac address="fa:16:3e:05:9f:63"/>
Aug 16 15:08:49 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:49 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:08:49 user nova-compute[73091]:       <target dev="tapf94a19b5-a2"/>
Aug 16 15:08:49 user nova-compute[73091]:     </interface>
Aug 16 15:08:49 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:08:49 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/console.log" append="off"/>
Aug 16 15:08:49 user nova-compute[73091]:     </serial>
Aug 16 15:08:49 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:08:49 user nova-compute[73091]:     <video>
Aug 16 15:08:49 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:49 user nova-compute[73091]:     </video>
Aug 16 15:08:49 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:08:49 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:08:49 user nova-compute[73091]:     </rng>
Aug 16 15:08:49 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:08:49 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:08:49 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:08:49 user nova-compute[73091]:     </memballoon>
Aug 16 15:08:49 user nova-compute[73091]:   </devices>
Aug 16 15:08:49 user nova-compute[73091]: </domain>
Aug 16 15:08:49 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG os_vif [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf94a19b5-a2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf94a19b5-a2, col_values=(('external_ids', {'iface-id': 'f94a19b5-a285-4efb-9931-8f26831a7382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9f:63', 'vm-uuid': 'a42f48f4-9a4e-4b6f-b61c-59b8ba7de752'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:49 user nova-compute[73091]: INFO os_vif [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2')
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No VIF found with MAC fa:16:3e:05:9f:63, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.220s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk 1073741824" returned: 0 in 0.066s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.235s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Cannot resize image /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'migration_context' on Instance uuid 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Successfully created port: d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Ensure instance console log exists: /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updated VIF entry in instance network info cache for port f94a19b5-a285-4efb-9931-8f26831a7382. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99cfa777-650e-4c27-ba80-97e4a4b81c94 req-9d4833e5-ab09-4f51-84aa-014b41fae0d6 service nova] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Successfully updated port: d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-1b71c1e6-8c5a-4052-b33f-6c7ebed69879" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-1b71c1e6-8c5a-4052-b33f-6c7ebed69879" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-changed-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Refreshing instance network info cache due to event network-changed-d42c541f-033a-4758-a092-068b7eeb509e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] Acquiring lock "refresh_cache-1b71c1e6-8c5a-4052-b33f-6c7ebed69879" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Updating instance_info_cache with network_info: [{"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-1b71c1e6-8c5a-4052-b33f-6c7ebed69879" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Instance network_info: |[{"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] Acquired lock "refresh_cache-1b71c1e6-8c5a-4052-b33f-6c7ebed69879" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Refreshing network info cache for port d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Start _get_guest_xml network_info=[{"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:08:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068748105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068748105',id=24,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-i8te08g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:49Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=1b71c1e6-8c5a-4052-b33f-6c7ebed69879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-f777bd89-172e-48a8-a210-a686ebfe2c19 req-1c1a8eea-8453-4c69-be70-ce3d6e254909 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f777bd89-172e-48a8-a210-a686ebfe2c19 req-1c1a8eea-8453-4c69-be70-ce3d6e254909 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f777bd89-172e-48a8-a210-a686ebfe2c19 req-1c1a8eea-8453-4c69-be70-ce3d6e254909 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f777bd89-172e-48a8-a210-a686ebfe2c19 req-1c1a8eea-8453-4c69-be70-ce3d6e254909 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-f777bd89-172e-48a8-a210-a686ebfe2c19 req-1c1a8eea-8453-4c69-be70-ce3d6e254909 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:51 user nova-compute[73091]: WARNING nova.compute.manager [req-f777bd89-172e-48a8-a210-a686ebfe2c19 req-1c1a8eea-8453-4c69-be70-ce3d6e254909 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state building and task_state spawning.
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:08:51 user nova-compute[73091]:   <uuid>1b71c1e6-8c5a-4052-b33f-6c7ebed69879</uuid>
Aug 16 15:08:51 user nova-compute[73091]:   <name>instance-00000018</name>
Aug 16 15:08:51 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:08:51 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:08:51 user nova-compute[73091]:   <metadata>
Aug 16 15:08:51 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:08:51 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:08:51 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2068748105</nova:name>
Aug 16 15:08:51 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:08:51</nova:creationTime>
Aug 16 15:08:51 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:08:51 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:08:51 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:08:51 user nova-compute[73091]:       <nova:owner>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:user uuid="c0243ed66e484f6a820421b1f69ece02">tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member</nova:user>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:project uuid="7c4d07f3079144a59f93086e00017115">tempest-ServerBootFromVolumeStableRescueTest-909556237</nova:project>
Aug 16 15:08:51 user nova-compute[73091]:       </nova:owner>
Aug 16 15:08:51 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:08:51 user nova-compute[73091]:       <nova:ports>
Aug 16 15:08:51 user nova-compute[73091]:         <nova:port uuid="d42c541f-033a-4758-a092-068b7eeb509e">
Aug 16 15:08:51 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:08:51 user nova-compute[73091]:         </nova:port>
Aug 16 15:08:51 user nova-compute[73091]:       </nova:ports>
Aug 16 15:08:51 user nova-compute[73091]:     </nova:instance>
Aug 16 15:08:51 user nova-compute[73091]:   </metadata>
Aug 16 15:08:51 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:08:51 user nova-compute[73091]:     <system>
Aug 16 15:08:51 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:08:51 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:08:51 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:08:51 user nova-compute[73091]:       <entry name="serial">1b71c1e6-8c5a-4052-b33f-6c7ebed69879</entry>
Aug 16 15:08:51 user nova-compute[73091]:       <entry name="uuid">1b71c1e6-8c5a-4052-b33f-6c7ebed69879</entry>
Aug 16 15:08:51 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:08:51 user nova-compute[73091]:     </system>
Aug 16 15:08:51 user nova-compute[73091]:   </sysinfo>
Aug 16 15:08:51 user nova-compute[73091]:   <os>
Aug 16 15:08:51 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:08:51 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:08:51 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:08:51 user nova-compute[73091]:   </os>
Aug 16 15:08:51 user nova-compute[73091]:   <features>
Aug 16 15:08:51 user nova-compute[73091]:     <acpi/>
Aug 16 15:08:51 user nova-compute[73091]:     <apic/>
Aug 16 15:08:51 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:08:51 user nova-compute[73091]:   </features>
Aug 16 15:08:51 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:08:51 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:08:51 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:08:51 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:08:51 user nova-compute[73091]:   </clock>
Aug 16 15:08:51 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:08:51 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:08:51 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:08:51 user nova-compute[73091]:   </cpu>
Aug 16 15:08:51 user nova-compute[73091]:   <devices>
Aug 16 15:08:51 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:08:51 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:08:51 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk"/>
Aug 16 15:08:51 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:08:51 user nova-compute[73091]:     </disk>
Aug 16 15:08:51 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:08:51 user nova-compute[73091]:       <mac address="fa:16:3e:ab:7c:47"/>
Aug 16 15:08:51 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:51 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:08:51 user nova-compute[73091]:       <target dev="tapd42c541f-03"/>
Aug 16 15:08:51 user nova-compute[73091]:     </interface>
Aug 16 15:08:51 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:08:51 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/console.log" append="off"/>
Aug 16 15:08:51 user nova-compute[73091]:     </serial>
Aug 16 15:08:51 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:08:51 user nova-compute[73091]:     <video>
Aug 16 15:08:51 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:51 user nova-compute[73091]:     </video>
Aug 16 15:08:51 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:08:51 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:08:51 user nova-compute[73091]:     </rng>
Aug 16 15:08:51 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:08:51 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:08:51 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:08:51 user nova-compute[73091]:     </memballoon>
Aug 16 15:08:51 user nova-compute[73091]:   </devices>
Aug 16 15:08:51 user nova-compute[73091]: </domain>
Aug 16 15:08:51 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068748105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068748105',id=24,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-i8te08g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:49Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=1b71c1e6-8c5a-4052-b33f-6c7ebed69879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG os_vif [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd42c541f-03, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd42c541f-03, col_values=(('external_ids', {'iface-id': 'd42c541f-033a-4758-a092-068b7eeb509e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:7c:47', 'vm-uuid': '1b71c1e6-8c5a-4052-b33f-6c7ebed69879'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: INFO os_vif [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03')
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:08:51 user nova-compute[73091]: INFO nova.compute.claims [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Claim successful on node user
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No VIF found with MAC fa:16:3e:ab:7c:47, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:08:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.policy [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9348c14ed1dc496ebf20d26e3b31779a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cabeffd95264d63aa6802f8a91387e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:08:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Creating image(s)
Aug 16 15:08:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Updated VIF entry in instance network info cache for port d42c541f-033a-4758-a092-068b7eeb509e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Updating instance_info_cache with network_info: [{"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-65183e24-97af-4835-8776-4c49a729fa6e req-60db69ed-efe0-461c-baf1-d3ada50a86ab service nova] Releasing lock "refresh_cache-1b71c1e6-8c5a-4052-b33f-6c7ebed69879" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.235s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk 1073741824" returned: 0 in 0.078s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198518.5577984, 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] VM Stopped (Lifecycle Event)
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-228c5b19-637f-4698-bff9-77932d2d231c None None] [instance: 693b6f64-f23b-438a-8aa6-97f2ed7f9b7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Successfully created port: d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198533.7473977, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Resumed (Lifecycle Event)
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance spawned successfully.
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198533.7480466, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Started (Lifecycle Event)
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-275cb9be-460e-4342-8ddb-91f7e31cc27f req-c80cfab3-389b-437f-84c7-4821aa001dde service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-275cb9be-460e-4342-8ddb-91f7e31cc27f req-c80cfab3-389b-437f-84c7-4821aa001dde service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-275cb9be-460e-4342-8ddb-91f7e31cc27f req-c80cfab3-389b-437f-84c7-4821aa001dde service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-275cb9be-460e-4342-8ddb-91f7e31cc27f req-c80cfab3-389b-437f-84c7-4821aa001dde service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-275cb9be-460e-4342-8ddb-91f7e31cc27f req-c80cfab3-389b-437f-84c7-4821aa001dde service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:53 user nova-compute[73091]: WARNING nova.compute.manager [req-275cb9be-460e-4342-8ddb-91f7e31cc27f req-c80cfab3-389b-437f-84c7-4821aa001dde service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state building and task_state spawning.
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:08:53 user nova-compute[73091]: INFO nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Took 8.25 seconds to spawn the instance on the hypervisor.
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Cannot resize image /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:08:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'migration_context' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-e243301d-38cb-412a-81ea-18ac8d3f5bff req-7149a54c-db2a-4dc4-862f-3eb05446e680 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e243301d-38cb-412a-81ea-18ac8d3f5bff req-7149a54c-db2a-4dc4-862f-3eb05446e680 service nova] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e243301d-38cb-412a-81ea-18ac8d3f5bff req-7149a54c-db2a-4dc4-862f-3eb05446e680 service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e243301d-38cb-412a-81ea-18ac8d3f5bff req-7149a54c-db2a-4dc4-862f-3eb05446e680 service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-e243301d-38cb-412a-81ea-18ac8d3f5bff req-7149a54c-db2a-4dc4-862f-3eb05446e680 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] No waiting events found dispatching network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:54 user nova-compute[73091]: WARNING nova.compute.manager [req-e243301d-38cb-412a-81ea-18ac8d3f5bff req-7149a54c-db2a-4dc4-862f-3eb05446e680 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received unexpected event network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e for instance with vm_state building and task_state spawning.
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Ensure instance console log exists: /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:54 user nova-compute[73091]: INFO nova.compute.manager [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Took 9.17 seconds to build instance.
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca2498b2-b21e-4347-8ffb-390df8474b04 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.350s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Successfully updated port: d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing instance network info cache due to event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:08:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance network_info: |[{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Start _get_guest_xml network_info=[{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920729177',display_name='tempest-ServerRescueNegativeTestJSON-server-920729177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920729177',id=25,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFrlhy1Sn18rFziQLvR7ck0OWZ0Nn3+QEeu842U/5Tb41Xo+utkGsudC70oKMuV5erO3jTN73jNOYID0yIThT3L/ST2g1Hsf3ILwdV+oy4rBykFqhsETxawdFd9JZlxuQ==',key_name='tempest-keypair-1819551141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-qt2chcaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=86f25d04-d425-4fcb-b502-f9d0ddee8b6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'pci_devices' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:08:55 user nova-compute[73091]:   <uuid>86f25d04-d425-4fcb-b502-f9d0ddee8b6f</uuid>
Aug 16 15:08:55 user nova-compute[73091]:   <name>instance-00000019</name>
Aug 16 15:08:55 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:08:55 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:08:55 user nova-compute[73091]:   <metadata>
Aug 16 15:08:55 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:08:55 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:08:55 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-920729177</nova:name>
Aug 16 15:08:55 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:08:55</nova:creationTime>
Aug 16 15:08:55 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:08:55 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:08:55 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:08:55 user nova-compute[73091]:       <nova:owner>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:user uuid="9348c14ed1dc496ebf20d26e3b31779a">tempest-ServerRescueNegativeTestJSON-789793483-project-member</nova:user>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:project uuid="4cabeffd95264d63aa6802f8a91387e9">tempest-ServerRescueNegativeTestJSON-789793483</nova:project>
Aug 16 15:08:55 user nova-compute[73091]:       </nova:owner>
Aug 16 15:08:55 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:08:55 user nova-compute[73091]:       <nova:ports>
Aug 16 15:08:55 user nova-compute[73091]:         <nova:port uuid="d6c4e4b6-5546-4221-8ec4-67a554f5c00d">
Aug 16 15:08:55 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 15:08:55 user nova-compute[73091]:         </nova:port>
Aug 16 15:08:55 user nova-compute[73091]:       </nova:ports>
Aug 16 15:08:55 user nova-compute[73091]:     </nova:instance>
Aug 16 15:08:55 user nova-compute[73091]:   </metadata>
Aug 16 15:08:55 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:08:55 user nova-compute[73091]:     <system>
Aug 16 15:08:55 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:08:55 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:08:55 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:08:55 user nova-compute[73091]:       <entry name="serial">86f25d04-d425-4fcb-b502-f9d0ddee8b6f</entry>
Aug 16 15:08:55 user nova-compute[73091]:       <entry name="uuid">86f25d04-d425-4fcb-b502-f9d0ddee8b6f</entry>
Aug 16 15:08:55 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:08:55 user nova-compute[73091]:     </system>
Aug 16 15:08:55 user nova-compute[73091]:   </sysinfo>
Aug 16 15:08:55 user nova-compute[73091]:   <os>
Aug 16 15:08:55 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:08:55 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:08:55 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:08:55 user nova-compute[73091]:   </os>
Aug 16 15:08:55 user nova-compute[73091]:   <features>
Aug 16 15:08:55 user nova-compute[73091]:     <acpi/>
Aug 16 15:08:55 user nova-compute[73091]:     <apic/>
Aug 16 15:08:55 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:08:55 user nova-compute[73091]:   </features>
Aug 16 15:08:55 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:08:55 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:08:55 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:08:55 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:08:55 user nova-compute[73091]:   </clock>
Aug 16 15:08:55 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:08:55 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:08:55 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:08:55 user nova-compute[73091]:   </cpu>
Aug 16 15:08:55 user nova-compute[73091]:   <devices>
Aug 16 15:08:55 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:08:55 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:08:55 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk"/>
Aug 16 15:08:55 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:08:55 user nova-compute[73091]:     </disk>
Aug 16 15:08:55 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:08:55 user nova-compute[73091]:       <mac address="fa:16:3e:9d:35:5f"/>
Aug 16 15:08:55 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:55 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:08:55 user nova-compute[73091]:       <target dev="tapd6c4e4b6-55"/>
Aug 16 15:08:55 user nova-compute[73091]:     </interface>
Aug 16 15:08:55 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:08:55 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/console.log" append="off"/>
Aug 16 15:08:55 user nova-compute[73091]:     </serial>
Aug 16 15:08:55 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:08:55 user nova-compute[73091]:     <video>
Aug 16 15:08:55 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:08:55 user nova-compute[73091]:     </video>
Aug 16 15:08:55 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:08:55 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:08:55 user nova-compute[73091]:     </rng>
Aug 16 15:08:55 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:08:55 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:08:55 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:08:55 user nova-compute[73091]:     </memballoon>
Aug 16 15:08:55 user nova-compute[73091]:   </devices>
Aug 16 15:08:55 user nova-compute[73091]: </domain>
Aug 16 15:08:55 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920729177',display_name='tempest-ServerRescueNegativeTestJSON-server-920729177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920729177',id=25,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFrlhy1Sn18rFziQLvR7ck0OWZ0Nn3+QEeu842U/5Tb41Xo+utkGsudC70oKMuV5erO3jTN73jNOYID0yIThT3L/ST2g1Hsf3ILwdV+oy4rBykFqhsETxawdFd9JZlxuQ==',key_name='tempest-keypair-1819551141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-qt2chcaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=86f25d04-d425-4fcb-b502-f9d0ddee8b6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG os_vif [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c4e4b6-55, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6c4e4b6-55, col_values=(('external_ids', {'iface-id': 'd6c4e4b6-5546-4221-8ec4-67a554f5c00d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:35:5f', 'vm-uuid': '86f25d04-d425-4fcb-b502-f9d0ddee8b6f'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:55 user nova-compute[73091]: INFO os_vif [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55')
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:9d:35:5f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:08:55 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198535.9915543, 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:55 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] VM Resumed (Lifecycle Event)
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Instance spawned successfully.
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198535.9998133, 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] VM Started (Lifecycle Event)
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-f8f580e2-2128-4991-8458-7bbc3b501310 req-bdbc9bcf-59a1-4947-b3dc-97f547ba9fae service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f8f580e2-2128-4991-8458-7bbc3b501310 req-bdbc9bcf-59a1-4947-b3dc-97f547ba9fae service nova] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f8f580e2-2128-4991-8458-7bbc3b501310 req-bdbc9bcf-59a1-4947-b3dc-97f547ba9fae service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f8f580e2-2128-4991-8458-7bbc3b501310 req-bdbc9bcf-59a1-4947-b3dc-97f547ba9fae service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-f8f580e2-2128-4991-8458-7bbc3b501310 req-bdbc9bcf-59a1-4947-b3dc-97f547ba9fae service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] No waiting events found dispatching network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:56 user nova-compute[73091]: WARNING nova.compute.manager [req-f8f580e2-2128-4991-8458-7bbc3b501310 req-bdbc9bcf-59a1-4947-b3dc-97f547ba9fae service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received unexpected event network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e for instance with vm_state building and task_state spawning.
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:56 user nova-compute[73091]: INFO nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:08:56 user nova-compute[73091]: INFO nova.compute.manager [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Took 7.94 seconds to build instance.
Aug 16 15:08:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dbddd20e-32d0-4e05-bdc0-d54665594341 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.080s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updated VIF entry in instance network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:08:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f5bda375-1cfa-4df3-8254-c22ea2d7f8ca req-7bcd24ca-d8ba-4ecc-9059-7d2990e8524d service nova] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ddf34fa-113e-4057-bef4-f7a0a49a9cc3 req-f5f8c8fe-3339-4655-840c-3526fcd35997 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ddf34fa-113e-4057-bef4-f7a0a49a9cc3 req-f5f8c8fe-3339-4655-840c-3526fcd35997 service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ddf34fa-113e-4057-bef4-f7a0a49a9cc3 req-f5f8c8fe-3339-4655-840c-3526fcd35997 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ddf34fa-113e-4057-bef4-f7a0a49a9cc3 req-f5f8c8fe-3339-4655-840c-3526fcd35997 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ddf34fa-113e-4057-bef4-f7a0a49a9cc3 req-f5f8c8fe-3339-4655-840c-3526fcd35997 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:57 user nova-compute[73091]: WARNING nova.compute.manager [req-5ddf34fa-113e-4057-bef4-f7a0a49a9cc3 req-f5f8c8fe-3339-4655-840c-3526fcd35997 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state building and task_state spawning.
Aug 16 15:08:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-75475a55-b1ef-4de5-8e28-5a74642946c8 req-d10903ff-b33d-42ba-a892-ba83038a32b2 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75475a55-b1ef-4de5-8e28-5a74642946c8 req-d10903ff-b33d-42ba-a892-ba83038a32b2 service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75475a55-b1ef-4de5-8e28-5a74642946c8 req-d10903ff-b33d-42ba-a892-ba83038a32b2 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75475a55-b1ef-4de5-8e28-5a74642946c8 req-d10903ff-b33d-42ba-a892-ba83038a32b2 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-75475a55-b1ef-4de5-8e28-5a74642946c8 req-d10903ff-b33d-42ba-a892-ba83038a32b2 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:08:59 user nova-compute[73091]: WARNING nova.compute.manager [req-75475a55-b1ef-4de5-8e28-5a74642946c8 req-d10903ff-b33d-42ba-a892-ba83038a32b2 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state building and task_state spawning.
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198539.598234, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:59 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Resumed (Lifecycle Event)
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:08:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance spawned successfully.
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:08:59 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198539.6112938, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:08:59 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Started (Lifecycle Event)
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:08:59 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:08:59 user nova-compute[73091]: INFO nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 16 15:08:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:09:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Took 8.18 seconds to build instance.
Aug 16 15:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a51743b4-3805-4f52-a0ff-2553bca7b3df tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-changed-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Refreshing instance network info cache due to event network-changed-424310e7-89cb-41e8-b921-35d0fed0e52b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] Acquiring lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] Acquired lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Refreshing network info cache for port 424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'flavor' on Instance uuid 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Ignoring supplied device name: /dev/vdb
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:08 user nova-compute[73091]: INFO nova.compute.manager [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Attaching volume 1945677b-dc7f-48cb-8305-4c94adcf1c92 to /dev/vdb
Aug 16 15:09:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updated VIF entry in instance network info cache for port 424310e7-89cb-41e8-b921-35d0fed0e52b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updating instance_info_cache with network_info: [{"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c8207085-b19a-4e3d-9239-9b9f1881c881 req-d4a513e0-b4f2-4f6d-936c-2980551aaee2 service nova] Releasing lock "refresh_cache-99360337-b6a6-46d0-b65a-b67441b0c4d9" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e8cdb1-9468-4355-9b15-a623f017692f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[052eda6e-dd44-4036-9421-0fc1f3363e86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3301ae7a-6cf2-4635-8c15-0408fcbd96bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d746902-093e-4615-b222-85f72e478733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:09:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffb6762-b91c-4c94-b019-c642204613bb]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updating existing volume attachment record: 522b6d91-6a60-4320-95a0-2f3f00e937da {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:09:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:09:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7098MB free_disk=25.510330200195312GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:09:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:09:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:09:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:09:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:11 user nova-compute[73091]: INFO nova.compute.manager [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Terminating instance
Aug 16 15:09:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcf0f39f-755a-40c9-9a47-e1bf557408cc req-01c653dc-f3f9-4bb2-b35f-52684b53b482 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-vif-unplugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcf0f39f-755a-40c9-9a47-e1bf557408cc req-01c653dc-f3f9-4bb2-b35f-52684b53b482 service nova] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcf0f39f-755a-40c9-9a47-e1bf557408cc req-01c653dc-f3f9-4bb2-b35f-52684b53b482 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcf0f39f-755a-40c9-9a47-e1bf557408cc req-01c653dc-f3f9-4bb2-b35f-52684b53b482 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcf0f39f-755a-40c9-9a47-e1bf557408cc req-01c653dc-f3f9-4bb2-b35f-52684b53b482 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] No waiting events found dispatching network-vif-unplugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:09:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcf0f39f-755a-40c9-9a47-e1bf557408cc req-01c653dc-f3f9-4bb2-b35f-52684b53b482 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-vif-unplugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:09:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Instance destroyed successfully.
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lazy-loading 'resources' on Instance uuid 4481eb2c-88c2-4ada-a08f-31a9c3d325cd {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-927453113',display_name='tempest-ServersNegativeTestJSON-server-927453113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-927453113',id=3,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6131b7ede5ec41eb9441f103318fe81f',ramdisk_id='',reservation_id='r-saq7dyz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-290315528',owner_user_name='tempest-ServersNegativeTestJSON-290315528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:00:35Z,user_data=None,user_id='058c604dd70b49f6b8fa356a81344415',uuid=4481eb2c-88c2-4ada-a08f-31a9c3d325cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converting VIF {"id": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "address": "fa:16:3e:ab:d6:82", "network": {"id": "97ed5e47-049f-47a2-835e-ebfa232eba83", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-272322247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6131b7ede5ec41eb9441f103318fe81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab6af4f3-d9", "ovs_interfaceid": "ab6af4f3-d9c3-404b-8496-8db3fe081883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG os_vif [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab6af4f3-d9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:09:12 user nova-compute[73091]: INFO os_vif [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:d6:82,bridge_name='br-int',has_traffic_filtering=True,id=ab6af4f3-d9c3-404b-8496-8db3fe081883,network=Network(97ed5e47-049f-47a2-835e-ebfa232eba83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab6af4f3-d9')
Aug 16 15:09:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Deleting instance files /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd_del
Aug 16 15:09:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Deletion of /opt/stack/data/nova/instances/4481eb2c-88c2-4ada-a08f-31a9c3d325cd_del complete
Aug 16 15:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:12 user nova-compute[73091]: INFO nova.compute.manager [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:09:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Took 0.77 seconds to deallocate network for instance.
Aug 16 15:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:13 user nova-compute[73091]: INFO nova.compute.manager [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Detaching volume 6e07b9f5-ab80-4ffa-b39c-592d95200cf8
Aug 16 15:09:13 user nova-compute[73091]: INFO nova.virt.block_device [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Attempting to driver detach volume 6e07b9f5-ab80-4ffa-b39c-592d95200cf8 from mountpoint /dev/vdb
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Attempting to detach device vdb from instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:09:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:09:13 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:09:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:09:13 user nova-compute[73091]:   <serial>6e07b9f5-ab80-4ffa-b39c-592d95200cf8</serial>
Aug 16 15:09:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:09:13 user nova-compute[73091]: </disk>
Aug 16 15:09:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:09:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully detached device vdb from instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 from the persistent domain config.
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:09:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:09:13 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:09:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:09:13 user nova-compute[73091]:   <serial>6e07b9f5-ab80-4ffa-b39c-592d95200cf8</serial>
Aug 16 15:09:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:09:13 user nova-compute[73091]: </disk>
Aug 16 15:09:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:13 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Deleted allocations for instance 4481eb2c-88c2-4ada-a08f-31a9c3d325cd
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] Acquiring lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] No waiting events found dispatching network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:09:14 user nova-compute[73091]: WARNING nova.compute.manager [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received unexpected event network-vif-plugged-ab6af4f3-d9c3-404b-8496-8db3fe081883 for instance with vm_state deleted and task_state None.
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-29bf500a-6242-4225-b97d-71c4a8570070 req-4ead94ad-3d81-4734-8c4a-34ea259cdc77 service nova] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Received event network-vif-deleted-ab6af4f3-d9c3-404b-8496-8db3fe081883 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bb49a384-dad8-49cc-903f-d5923a647846 tempest-ServersNegativeTestJSON-290315528 tempest-ServersNegativeTestJSON-290315528-project-member] Lock "4481eb2c-88c2-4ada-a08f-31a9c3d325cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198554.3121874, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:09:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully detached device vdb from instance 8d21e8b1-c405-4d34-a582-ec36fdefe584 from the live domain config.
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOWiaPQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:09:14 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb3bebd-3f86-4cae-9b40-1b7be84e5e29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af70a55-4c5a-4271-8b9e-594b3f794977]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:14 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:09:14 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:14 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 (non-flash)
Aug 16 15:09:14 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c5c6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93233448-6ed7-4138-84b6-e6e29b41cec5]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d9de9-bbba-4a40-8108-c307225bc5ed]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab7886-f996-4321-a4c9-1f13af5d5772]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.136s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[015819f1-ffea-4f4a-a0f4-e4ecc0b4ff45]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8686a7a-f145-4eed-9dec-cb102e912b09]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.219s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6282e5ae-6dc8-488d-9ff0-cc522738618b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260]
Aug 16 15:09:14 user nova-compute[73091]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8, portal: 172.16.0.220,3260] successful.
Aug 16 15:09:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e07b9f5-ab80-4ffa-b39c-592d95200cf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe18406-4100-4b18-a88e-b6e036458dad]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.581s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== disconnect_volume: return (582ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:09:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'flavor' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e4bc9c17-720b-4a13-acef-26596db1c9d4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:09:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPOwNWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:09:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:09:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:09:20 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b6e62-a9cf-4b5d-b2f8-dec9f3f0a8c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:09:20 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2877f6-c9ec-470d-9bcf-8d57aab46fd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92] added
Aug 16 15:09:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b924f111-fbc8-4a3a-a87e-cbd5b9810406]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed8db2-931c-4ec5-a33a-8efeb6bf5f10]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGPOwNWm {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGPOwNWm" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4050b402-7333-45d9-b230-93c94d442875]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGPOwNWm'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb921c58-311b-4237-9d6f-d9d0fa3684cf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f50321-1e05-4862-a166-4eb39c6aa939]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dc538d-7892-405b-b206-ff8212d49f53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260]
Aug 16 15:09:20 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260] successful.
Aug 16 15:09:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05ff96-1d26-417d-b946-3d34559e6bb8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0605f668-25de-4eb4-9493-3cdfe91316ca]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:20 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)
Aug 16 15:09:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:20 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)
Aug 16 15:09:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43690d0-b67f-45a8-be9d-8124be172206]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:09:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPOwNWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26636663262366539', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663262366539', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'flavor' on Instance uuid 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:09:21 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:09:21 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:09:21 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:09:21 user nova-compute[73091]:   <serial>1945677b-dc7f-48cb-8305-4c94adcf1c92</serial>
Aug 16 15:09:21 user nova-compute[73091]: </disk>
Aug 16 15:09:21 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:09:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No VIF found with MAC fa:16:3e:31:95:b9, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4938a06a-3487-4b2a-9e31-568934b0997f tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.075s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:27 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198552.5077047, 4481eb2c-88c2-4ada-a08f-31a9c3d325cd => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:09:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] VM Stopped (Lifecycle Event)
Aug 16 15:09:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-12e3241e-c633-4b49-a536-b284386d05c9 None None] [instance: 4481eb2c-88c2-4ada-a08f-31a9c3d325cd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:09:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:09:34 user nova-compute[73091]: INFO nova.compute.claims [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Claim successful on node user
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.788s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:09:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:09:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG nova.policy [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f00f519b688c4e2fbddbb792c9d02538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0baba8e83d4fde9afda048ecd7b317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:09:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Creating image(s)
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "/opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "/opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.260s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.225s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk 1073741824" returned: 0 in 0.063s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:09:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Cannot resize image /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'migration_context' on Instance uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Ensure instance console log exists: /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Successfully created port: e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Successfully updated port: e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquired lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-changed-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Refreshing instance network info cache due to event network-changed-e965c54c-3553-4055-946d-90c0a9225618. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] Acquiring lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating instance_info_cache with network_info: [{"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Releasing lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Instance network_info: |[{"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] Acquired lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Refreshing network info cache for port e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Start _get_guest_xml network_info=[{"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:09:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:09:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-532972590',display_name='tempest-TestStampPattern-server-532972590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-532972590',id=26,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyyAHLuiEqk4ejPwZhUcUKJyBqGOrb26zCZeDgHOg2VmzOCttHuqlkmEdCyFVOyQf9aIP2jNoS5d8k16YNuBnyk8HTbk6rg3OFMv70c4z0S2JbDt5MlYiurLWhEiKpxw==',key_name='tempest-TestStampPattern-728212450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0baba8e83d4fde9afda048ecd7b317',ramdisk_id='',reservation_id='r-0hp1ae6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1880881768',owner_user_name='tempest-TestStampPattern-1880881768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:09:35Z,user_data=None,user_id='f00f519b688c4e2fbddbb792c9d02538',uuid=fd4b79ad-6f00-41f3-addc-ada5aa1f84f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converting VIF {"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'pci_devices' on Instance uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:09:37 user nova-compute[73091]:   <uuid>fd4b79ad-6f00-41f3-addc-ada5aa1f84f6</uuid>
Aug 16 15:09:37 user nova-compute[73091]:   <name>instance-0000001a</name>
Aug 16 15:09:37 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:09:37 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:09:37 user nova-compute[73091]:   <metadata>
Aug 16 15:09:37 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:09:37 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:09:37 user nova-compute[73091]:       <nova:name>tempest-TestStampPattern-server-532972590</nova:name>
Aug 16 15:09:37 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:09:37</nova:creationTime>
Aug 16 15:09:37 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:09:37 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:09:37 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:09:37 user nova-compute[73091]:       <nova:owner>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:user uuid="f00f519b688c4e2fbddbb792c9d02538">tempest-TestStampPattern-1880881768-project-member</nova:user>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:project uuid="eb0baba8e83d4fde9afda048ecd7b317">tempest-TestStampPattern-1880881768</nova:project>
Aug 16 15:09:37 user nova-compute[73091]:       </nova:owner>
Aug 16 15:09:37 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:09:37 user nova-compute[73091]:       <nova:ports>
Aug 16 15:09:37 user nova-compute[73091]:         <nova:port uuid="e965c54c-3553-4055-946d-90c0a9225618">
Aug 16 15:09:37 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:09:37 user nova-compute[73091]:         </nova:port>
Aug 16 15:09:37 user nova-compute[73091]:       </nova:ports>
Aug 16 15:09:37 user nova-compute[73091]:     </nova:instance>
Aug 16 15:09:37 user nova-compute[73091]:   </metadata>
Aug 16 15:09:37 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:09:37 user nova-compute[73091]:     <system>
Aug 16 15:09:37 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:09:37 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:09:37 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:09:37 user nova-compute[73091]:       <entry name="serial">fd4b79ad-6f00-41f3-addc-ada5aa1f84f6</entry>
Aug 16 15:09:37 user nova-compute[73091]:       <entry name="uuid">fd4b79ad-6f00-41f3-addc-ada5aa1f84f6</entry>
Aug 16 15:09:37 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:09:37 user nova-compute[73091]:     </system>
Aug 16 15:09:37 user nova-compute[73091]:   </sysinfo>
Aug 16 15:09:37 user nova-compute[73091]:   <os>
Aug 16 15:09:37 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:09:37 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:09:37 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:09:37 user nova-compute[73091]:   </os>
Aug 16 15:09:37 user nova-compute[73091]:   <features>
Aug 16 15:09:37 user nova-compute[73091]:     <acpi/>
Aug 16 15:09:37 user nova-compute[73091]:     <apic/>
Aug 16 15:09:37 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:09:37 user nova-compute[73091]:   </features>
Aug 16 15:09:37 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:09:37 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:09:37 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:09:37 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:09:37 user nova-compute[73091]:   </clock>
Aug 16 15:09:37 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:09:37 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:09:37 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:09:37 user nova-compute[73091]:   </cpu>
Aug 16 15:09:37 user nova-compute[73091]:   <devices>
Aug 16 15:09:37 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:09:37 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:09:37 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk"/>
Aug 16 15:09:37 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:09:37 user nova-compute[73091]:     </disk>
Aug 16 15:09:37 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:09:37 user nova-compute[73091]:       <mac address="fa:16:3e:bb:d7:03"/>
Aug 16 15:09:37 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:09:37 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:09:37 user nova-compute[73091]:       <target dev="tape965c54c-35"/>
Aug 16 15:09:37 user nova-compute[73091]:     </interface>
Aug 16 15:09:37 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:09:37 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/console.log" append="off"/>
Aug 16 15:09:37 user nova-compute[73091]:     </serial>
Aug 16 15:09:37 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:09:37 user nova-compute[73091]:     <video>
Aug 16 15:09:37 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:09:37 user nova-compute[73091]:     </video>
Aug 16 15:09:37 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:09:37 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:09:37 user nova-compute[73091]:     </rng>
Aug 16 15:09:37 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:09:37 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:09:37 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:09:37 user nova-compute[73091]:     </memballoon>
Aug 16 15:09:37 user nova-compute[73091]:   </devices>
Aug 16 15:09:37 user nova-compute[73091]: </domain>
Aug 16 15:09:37 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-532972590',display_name='tempest-TestStampPattern-server-532972590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-532972590',id=26,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyyAHLuiEqk4ejPwZhUcUKJyBqGOrb26zCZeDgHOg2VmzOCttHuqlkmEdCyFVOyQf9aIP2jNoS5d8k16YNuBnyk8HTbk6rg3OFMv70c4z0S2JbDt5MlYiurLWhEiKpxw==',key_name='tempest-TestStampPattern-728212450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0baba8e83d4fde9afda048ecd7b317',ramdisk_id='',reservation_id='r-0hp1ae6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1880881768',owner_user_name='tempest-TestStampPattern-1880881768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:09:35Z,user_data=None,user_id='f00f519b688c4e2fbddbb792c9d02538',uuid=fd4b79ad-6f00-41f3-addc-ada5aa1f84f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converting VIF {"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG os_vif [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape965c54c-35, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape965c54c-35, col_values=(('external_ids', {'iface-id': 'e965c54c-3553-4055-946d-90c0a9225618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:d7:03', 'vm-uuid': 'fd4b79ad-6f00-41f3-addc-ada5aa1f84f6'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:37 user nova-compute[73091]: INFO os_vif [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35')
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No VIF found with MAC fa:16:3e:bb:d7:03, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updated VIF entry in instance network info cache for port e965c54c-3553-4055-946d-90c0a9225618. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating instance_info_cache with network_info: [{"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:09:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b113fd7-55d8-46ef-ad81-21aad9fc91c3 req-34c890fb-e74f-4992-ac06-a9b7a5d80b1f service nova] Releasing lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:09:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-10245a7c-592c-4ef6-98e0-ead70cbd44cb req-fc2779e3-8fc5-4381-bdea-2e5f7bd4b0d2 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-10245a7c-592c-4ef6-98e0-ead70cbd44cb req-fc2779e3-8fc5-4381-bdea-2e5f7bd4b0d2 service nova] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-10245a7c-592c-4ef6-98e0-ead70cbd44cb req-fc2779e3-8fc5-4381-bdea-2e5f7bd4b0d2 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-10245a7c-592c-4ef6-98e0-ead70cbd44cb req-fc2779e3-8fc5-4381-bdea-2e5f7bd4b0d2 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-10245a7c-592c-4ef6-98e0-ead70cbd44cb req-fc2779e3-8fc5-4381-bdea-2e5f7bd4b0d2 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] No waiting events found dispatching network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:09:39 user nova-compute[73091]: WARNING nova.compute.manager [req-10245a7c-592c-4ef6-98e0-ead70cbd44cb req-fc2779e3-8fc5-4381-bdea-2e5f7bd4b0d2 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received unexpected event network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 for instance with vm_state building and task_state spawning.
Aug 16 15:09:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-5e4d253e-d073-470c-b086-b28d885bd31a req-af988036-2c7c-4f1a-bc07-44a998cf8e80 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5e4d253e-d073-470c-b086-b28d885bd31a req-af988036-2c7c-4f1a-bc07-44a998cf8e80 service nova] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5e4d253e-d073-470c-b086-b28d885bd31a req-af988036-2c7c-4f1a-bc07-44a998cf8e80 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5e4d253e-d073-470c-b086-b28d885bd31a req-af988036-2c7c-4f1a-bc07-44a998cf8e80 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-5e4d253e-d073-470c-b086-b28d885bd31a req-af988036-2c7c-4f1a-bc07-44a998cf8e80 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] No waiting events found dispatching network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:09:41 user nova-compute[73091]: WARNING nova.compute.manager [req-5e4d253e-d073-470c-b086-b28d885bd31a req-af988036-2c7c-4f1a-bc07-44a998cf8e80 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received unexpected event network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 for instance with vm_state building and task_state spawning.
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198581.501831, fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] VM Resumed (Lifecycle Event)
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Instance spawned successfully.
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198581.5094907, fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] VM Started (Lifecycle Event)
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 16 15:09:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:09:41 user nova-compute[73091]: INFO nova.compute.manager [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Took 7.92 seconds to build instance.
Aug 16 15:09:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-066b467e-4edf-482e-8c8c-6797d81e3c7b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.054s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:56 user nova-compute[73091]: INFO nova.compute.manager [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Terminating instance
Aug 16 15:09:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6a184c0-9c47-4299-911d-4bfa92b8f77c req-2a77697f-de6e-4c3b-bb47-277f62bf3dae service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-unplugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6a184c0-9c47-4299-911d-4bfa92b8f77c req-2a77697f-de6e-4c3b-bb47-277f62bf3dae service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6a184c0-9c47-4299-911d-4bfa92b8f77c req-2a77697f-de6e-4c3b-bb47-277f62bf3dae service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6a184c0-9c47-4299-911d-4bfa92b8f77c req-2a77697f-de6e-4c3b-bb47-277f62bf3dae service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6a184c0-9c47-4299-911d-4bfa92b8f77c req-2a77697f-de6e-4c3b-bb47-277f62bf3dae service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-unplugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6a184c0-9c47-4299-911d-4bfa92b8f77c req-2a77697f-de6e-4c3b-bb47-277f62bf3dae service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-unplugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Instance destroyed successfully.
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lazy-loading 'resources' on Instance uuid 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-346040655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530517513',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpDK9diB/iGHmTw8zyI03BPzG0gmt19AjpasgRrC2AapJW9WduN0Sn1X12aXf3NAEQELnrpLB54g7QBcvHqnGSsePaPoddcVudgK9ELiSOj78jb5LBn41UHFf62ExadLw==',key_name='tempest-keypair-1560473014',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc86a892945c4fae9e5187741b6cb65c',ramdisk_id='',reservation_id='r-dctyxscq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725797811',owner_user_name='tempest-ServerActionsV293TestJSON-725797811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d227888e574b1ba4c8849fe85282a5',uuid=3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converting VIF {"id": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "address": "fa:16:3e:2a:9b:29", "network": {"id": "4e48a1ad-0986-47ca-a389-022b5d410cd4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1125365163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc86a892945c4fae9e5187741b6cb65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf56269d-0e", "ovs_interfaceid": "bf56269d-0e3e-4ece-98a3-8802f8a708d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_vif [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf56269d-0e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:09:58 user nova-compute[73091]: INFO os_vif [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9b:29,bridge_name='br-int',has_traffic_filtering=True,id=bf56269d-0e3e-4ece-98a3-8802f8a708d5,network=Network(4e48a1ad-0986-47ca-a389-022b5d410cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf56269d-0e')
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxQpUWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:09:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75736eea-c1fe-4835-97a5-6c70118d1374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875b49e5-fc97-4bad-8f4c-870a525bb0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4be1a-8753-48d1-97ec-7a57517a17e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875b49e5-fc97-4bad-8f4c-870a525bb0f8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:58 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:58 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)
Aug 16 15:09:58 user nova-compute[73091]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875b49e5-fc97-4bad-8f4c-870a525bb0f8 (non-flash)
Aug 16 15:09:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:09:58 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 (non-flash)
Aug 16 15:09:58 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)
Aug 16 15:09:58 user nova-compute[73091]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875b49e5-fc97-4bad-8f4c-870a525bb0f8 (non-flash)
Aug 16 15:09:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115428c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386845c-a4fd-4456-a892-fd55d681e4d9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976d63d-c5d8-42c4-a26a-1f40bb4dbb6d]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c94733-7b4c-4815-91bd-77f0d5686905]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f82515-c89f-4f9c-adf6-39470bc4a9b7]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a1da437', '/dev/disk/by-id/scsi-23834613762303234', '/dev/disk/by-id/scsi-1SCST_BIO9a1da437-84a7b02480688258') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f8c4f-6701-4d24-8c2d-131ac0be0100]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df60fb-ea52-47b3-a538-a8dc4592dbf5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc46614-552b-4ad3-8a84-7863a14d9eb7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260]
Aug 16 15:09:58 user nova-compute[73091]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721, portal: 172.16.0.220,3260] successful.
Aug 16 15:09:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9dd3520-e6ca-4515-8bd3-66858bb93721 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc9cfcf-f6ed-452d-b1ce-8667b4ec7051]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] <== disconnect_volume: return (394ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:09:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Deleting instance files /opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c_del
Aug 16 15:09:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Deletion of /opt/stack/data/nova/instances/3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c_del complete
Aug 16 15:09:58 user nova-compute[73091]: INFO nova.compute.manager [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Took 2.40 seconds to destroy the instance on the hypervisor.
Aug 16 15:09:58 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:09:58 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:09:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-f7bfb440-5345-4ab3-9bb5-b669c8341109 req-271e8f02-749f-40ac-bc82-3240f32dd260 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:09:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f7bfb440-5345-4ab3-9bb5-b669c8341109 req-271e8f02-749f-40ac-bc82-3240f32dd260 service nova] Acquiring lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:09:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f7bfb440-5345-4ab3-9bb5-b669c8341109 req-271e8f02-749f-40ac-bc82-3240f32dd260 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:09:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f7bfb440-5345-4ab3-9bb5-b669c8341109 req-271e8f02-749f-40ac-bc82-3240f32dd260 service nova] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:09:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-f7bfb440-5345-4ab3-9bb5-b669c8341109 req-271e8f02-749f-40ac-bc82-3240f32dd260 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] No waiting events found dispatching network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:09:59 user nova-compute[73091]: WARNING nova.compute.manager [req-f7bfb440-5345-4ab3-9bb5-b669c8341109 req-271e8f02-749f-40ac-bc82-3240f32dd260 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received unexpected event network-vif-plugged-bf56269d-0e3e-4ece-98a3-8802f8a708d5 for instance with vm_state active and task_state deleting.
Aug 16 15:09:59 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:09:59 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Took 1.07 seconds to deallocate network for instance.
Aug 16 15:10:00 user nova-compute[73091]: INFO nova.compute.manager [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Took 0.89 seconds to detach 1 volumes for instance.
Aug 16 15:10:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Deleting volume: e9dd3520-e6ca-4515-8bd3-66858bb93721 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 15:10:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:01 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:10:01 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:10:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:01 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Deleted allocations for instance 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c
Aug 16 15:10:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d86ef03-3140-4f57-83a3-b4f2a687bf1c req-b7761a4a-893a-43d0-a1f2-7736f54bbde4 service nova] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Received event network-vif-deleted-bf56269d-0e3e-4ece-98a3-8802f8a708d5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21bfe602-1b39-4553-922e-61c45c3a055d tempest-ServerActionsV293TestJSON-725797811 tempest-ServerActionsV293TestJSON-725797811-project-member] Lock "3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.244s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:03 user nova-compute[73091]: INFO nova.compute.manager [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Terminating instance
Aug 16 15:10:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-4825340f-e7f7-4106-954a-9440aefeadb8 req-e9c5362a-69a8-4774-83e0-9fd78602d39e service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-unplugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4825340f-e7f7-4106-954a-9440aefeadb8 req-e9c5362a-69a8-4774-83e0-9fd78602d39e service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4825340f-e7f7-4106-954a-9440aefeadb8 req-e9c5362a-69a8-4774-83e0-9fd78602d39e service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4825340f-e7f7-4106-954a-9440aefeadb8 req-e9c5362a-69a8-4774-83e0-9fd78602d39e service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-4825340f-e7f7-4106-954a-9440aefeadb8 req-e9c5362a-69a8-4774-83e0-9fd78602d39e service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-unplugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-4825340f-e7f7-4106-954a-9440aefeadb8 req-e9c5362a-69a8-4774-83e0-9fd78602d39e service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-unplugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Instance destroyed successfully.
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'resources' on Instance uuid 8d21e8b1-c405-4d34-a582-ec36fdefe584 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-659850977',display_name='tempest-ServerActionsTestOtherA-server-852391780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-659850977',id=16,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeWiWE+9Y36hTNKc+fw6eNSTabxWHKknbdUel+a8nBFzXqQa0lYg3YyUCzGRmZrHNtjHJRU5gFgxXjrrOzz7U3DFGvvdVnjDEmR5+IzaV3ICq/c9t4KSv3+veIY46b7Xw==',key_name='tempest-keypair-183354870',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-w3wwu798',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8d21e8b1-c405-4d34-a582-ec36fdefe584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "address": "fa:16:3e:62:e8:63", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58cb3a47-39", "ovs_interfaceid": "58cb3a47-39d4-400e-9cb3-05371a448fb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG os_vif [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58cb3a47-39, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:10:04 user nova-compute[73091]: INFO os_vif [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:e8:63,bridge_name='br-int',has_traffic_filtering=True,id=58cb3a47-39d4-400e-9cb3-05371a448fb6,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58cb3a47-39')
Aug 16 15:10:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Deleting instance files /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584_del
Aug 16 15:10:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Deletion of /opt/stack/data/nova/instances/8d21e8b1-c405-4d34-a582-ec36fdefe584_del complete
Aug 16 15:10:04 user nova-compute[73091]: INFO nova.compute.manager [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 15:10:04 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:10:04 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:06 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Took 1.22 seconds to deallocate network for instance.
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] Acquiring lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] No waiting events found dispatching network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:06 user nova-compute[73091]: WARNING nova.compute.manager [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received unexpected event network-vif-plugged-58cb3a47-39d4-400e-9cb3-05371a448fb6 for instance with vm_state deleted and task_state None.
Aug 16 15:10:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-efe2f2ae-419d-428d-9458-bb0fd3b84c09 req-99ef4c18-7cd0-4443-8683-c86547948dc3 service nova] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Received event network-vif-deleted-58cb3a47-39d4-400e-9cb3-05371a448fb6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.720s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:07 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Deleted allocations for instance 8d21e8b1-c405-4d34-a582-ec36fdefe584
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75fc5c35-c857-4406-82ac-d5e996c84108 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8d21e8b1-c405-4d34-a582-ec36fdefe584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.231s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:10:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.441871643066406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:10:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:10:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:13 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198597.9985466, 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] VM Stopped (Lifecycle Event)
Aug 16 15:10:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-789a2b40-073a-482a-8467-0ad9838d236b None None] [instance: 3d8dfa6c-4c4d-457a-be59-5f0dfe259b1c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:15 user nova-compute[73091]: INFO nova.compute.manager [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Unshelving
Aug 16 15:10:15 user nova-compute[73091]: INFO nova.virt.block_device [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Booting with volume 15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 at /dev/vdc
Aug 16 15:10:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f04432e-9171-4366-b225-fd14d59297d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c98dc7d-7247-4136-baab-1473ff9d8b1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f0c16c-5e6f-44e2-8375-eb02525e9006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66043f-7f1d-4c43-abc7-b259bafb1d6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:10:15 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79105015-89fb-4a16-b361-7165e43b906e]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:10:15 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating existing volume attachment record: 034ec9ce-a006-4147-92e1-eb7d705f4626 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:16 user nova-compute[73091]: INFO nova.compute.manager [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Detaching volume 1945677b-dc7f-48cb-8305-4c94adcf1c92
Aug 16 15:10:16 user nova-compute[73091]: INFO nova.virt.block_device [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Attempting to driver detach volume 1945677b-dc7f-48cb-8305-4c94adcf1c92 from mountpoint /dev/vdb
Aug 16 15:10:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Attempting to detach device vdb from instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:10:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:10:16 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:10:16 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:10:16 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:10:16 user nova-compute[73091]:   <serial>1945677b-dc7f-48cb-8305-4c94adcf1c92</serial>
Aug 16 15:10:16 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:10:16 user nova-compute[73091]: </disk>
Aug 16 15:10:16 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:10:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully detached device vdb from instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 from the persistent domain config.
Aug 16 15:10:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:10:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:10:16 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:10:16 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:10:16 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:10:16 user nova-compute[73091]:   <serial>1945677b-dc7f-48cb-8305-4c94adcf1c92</serial>
Aug 16 15:10:16 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:10:16 user nova-compute[73091]: </disk>
Aug 16 15:10:16 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198617.2777123, 99360337-b6a6-46d0-b65a-b67441b0c4d9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully detached device vdb from instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 from the live domain config.
Aug 16 15:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPOwNWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:10:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0d07f-2591-416e-90ae-03c0f2027eb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c2efb-689e-4da9-ac42-141eadc50df2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:17 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)
Aug 16 15:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:17 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 (non-flash)
Aug 16 15:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c526950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec2ed6-377f-4be9-9164-32976dc180e8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82498ed-9af0-4739-b07d-10ee343b7188]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3225213-ad08-4a2e-addd-910c54efa88f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bb8694-6d3b-4fb8-b2dc-3c8acf4318b9]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c0c67-769d-4062-b6ac-13efff0a39cc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c534ec3-2a3a-436a-9a33-6079701eab5d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260]
Aug 16 15:10:17 user nova-compute[73091]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92, portal: 172.16.0.220,3260] successful.
Aug 16 15:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6831aa-3ef8-46fe-b35d-bf71cadea696]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== disconnect_volume: return (320ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'flavor' on Instance uuid 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8d86409-a2f3-4eaf-9d46-184cc2168b02 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.931s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.778s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:18 user nova-compute[73091]: INFO nova.compute.manager [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Terminating instance
Aug 16 15:10:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-89f18325-4ab2-4751-a07f-80f7f2ab3a26 req-a8dc6550-fa1f-4cea-832f-f179e1000a0d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-vif-unplugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89f18325-4ab2-4751-a07f-80f7f2ab3a26 req-a8dc6550-fa1f-4cea-832f-f179e1000a0d service nova] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89f18325-4ab2-4751-a07f-80f7f2ab3a26 req-a8dc6550-fa1f-4cea-832f-f179e1000a0d service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89f18325-4ab2-4751-a07f-80f7f2ab3a26 req-a8dc6550-fa1f-4cea-832f-f179e1000a0d service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-89f18325-4ab2-4751-a07f-80f7f2ab3a26 req-a8dc6550-fa1f-4cea-832f-f179e1000a0d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] No waiting events found dispatching network-vif-unplugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-89f18325-4ab2-4751-a07f-80f7f2ab3a26 req-a8dc6550-fa1f-4cea-832f-f179e1000a0d service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-vif-unplugged-424310e7-89cb-41e8-b921-35d0fed0e52b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:10:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Instance destroyed successfully.
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'resources' on Instance uuid 99360337-b6a6-46d0-b65a-b67441b0c4d9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-322650660',display_name='tempest-VolumesSnapshotTestJSON-instance-322650660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-322650660',id=22,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnlM/NiKb8u2hYEtlLak/Oe4b2SESoJSo3cd3+0U75XPJ+cjcVrMpEK3Ce6/srCuu2ZP4Shh8kyKpDLi9pa/rKxKvm/REyA3+IT6Bin26YwRhCi1pi5p3xJzfnhr5PkiQ==',key_name='tempest-keypair-1192525417',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c654508f7acb4bc2b690668cfe19522d',ramdisk_id='',reservation_id='r-hiz5kuy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-903677429',owner_user_name='tempest-VolumesSnapshotTestJSON-903677429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ba771d2c1c4164aac60e2f80ce7e77',uuid=99360337-b6a6-46d0-b65a-b67441b0c4d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converting VIF {"id": "424310e7-89cb-41e8-b921-35d0fed0e52b", "address": "fa:16:3e:31:95:b9", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424310e7-89", "ovs_interfaceid": "424310e7-89cb-41e8-b921-35d0fed0e52b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_vif [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap424310e7-89, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:10:19 user nova-compute[73091]: INFO os_vif [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:95:b9,bridge_name='br-int',has_traffic_filtering=True,id=424310e7-89cb-41e8-b921-35d0fed0e52b,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424310e7-89')
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPOwNWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:10:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1945677b-dc7f-48cb-8305-4c94adcf1c92', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[652913dc-0757-4337-a3e5-2435be158245]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6187ec-4467-4b77-b86f-d1e30b4391f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c5795a0>, {}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== disconnect_volume: return (49ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:10:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Deleting instance files /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9_del
Aug 16 15:10:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Deletion of /opt/stack/data/nova/instances/99360337-b6a6-46d0-b65a-b67441b0c4d9_del complete
Aug 16 15:10:19 user nova-compute[73091]: INFO nova.compute.manager [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 16 15:10:19 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198604.7681816, 8d21e8b1-c405-4d34-a582-ec36fdefe584 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] VM Stopped (Lifecycle Event)
Aug 16 15:10:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e5fe1724-5cbd-46e3-9edf-b99f2469f97f None None] [instance: 8d21e8b1-c405-4d34-a582-ec36fdefe584] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:20 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Took 1.27 seconds to deallocate network for instance.
Aug 16 15:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-5e2c40c3-ee4b-438e-a8c0-6e4f497f51a6 req-2f980226-03e9-4d91-b6ba-e65d282f19bc service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-vif-deleted-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:20 user nova-compute[73091]: INFO nova.compute.manager [req-5e2c40c3-ee4b-438e-a8c0-6e4f497f51a6 req-2f980226-03e9-4d91-b6ba-e65d282f19bc service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Neutron deleted interface 424310e7-89cb-41e8-b921-35d0fed0e52b; detaching it from the instance and deleting it from the info cache
Aug 16 15:10:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-5e2c40c3-ee4b-438e-a8c0-6e4f497f51a6 req-2f980226-03e9-4d91-b6ba-e65d282f19bc service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:20 user nova-compute[73091]: WARNING nova.volume.cinder [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Attachment 522b6d91-6a60-4320-95a0-2f3f00e937da does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 522b6d91-6a60-4320-95a0-2f3f00e937da. (HTTP 404) (Request-ID: req-659851ee-af21-44ae-974a-6c88615117be)
Aug 16 15:10:20 user nova-compute[73091]: INFO nova.compute.manager [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 15:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-5e2c40c3-ee4b-438e-a8c0-6e4f497f51a6 req-2f980226-03e9-4d91-b6ba-e65d282f19bc service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Detach interface failed, port_id=424310e7-89cb-41e8-b921-35d0fed0e52b, reason: Instance 99360337-b6a6-46d0-b65a-b67441b0c4d9 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-e911454f-7cec-42bd-909b-060574403efa req-d43d5252-d787-4a0c-aeff-cbcf3b738101 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received event network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e911454f-7cec-42bd-909b-060574403efa req-d43d5252-d787-4a0c-aeff-cbcf3b738101 service nova] Acquiring lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e911454f-7cec-42bd-909b-060574403efa req-d43d5252-d787-4a0c-aeff-cbcf3b738101 service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e911454f-7cec-42bd-909b-060574403efa req-d43d5252-d787-4a0c-aeff-cbcf3b738101 service nova] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-e911454f-7cec-42bd-909b-060574403efa req-d43d5252-d787-4a0c-aeff-cbcf3b738101 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] No waiting events found dispatching network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:20 user nova-compute[73091]: WARNING nova.compute.manager [req-e911454f-7cec-42bd-909b-060574403efa req-d43d5252-d787-4a0c-aeff-cbcf3b738101 service nova] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Received unexpected event network-vif-plugged-424310e7-89cb-41e8-b921-35d0fed0e52b for instance with vm_state active and task_state deleting.
Aug 16 15:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:10:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:21 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Deleted allocations for instance 99360337-b6a6-46d0-b65a-b67441b0c4d9
Aug 16 15:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e884f9c4-bc92-48a8-95be-c0fb8e16b5ff tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "99360337-b6a6-46d0-b65a-b67441b0c4d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.904s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'pci_requests' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'numa_topology' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:10:27 user nova-compute[73091]: INFO nova.compute.claims [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Claim successful on node user
Aug 16 15:10:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:27 user nova-compute[73091]: INFO nova.network.neutron [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating port 63bacab4-3783-4ad9-8076-c90b88f0d3fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing instance network info cache due to event network-changed-63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] Acquiring lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:10:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Creating image(s)
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] Acquired lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Refreshing network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "af36b13246a2ed571292a301dac09b8cf761601f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "af36b13246a2ed571292a301dac09b8cf761601f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.part --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG nova.virt.images [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] 775551e7-f243-4304-934d-b40d1268022b was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.part /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.part /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.converted" returned: 0 in 0.305s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updated VIF entry in instance network info cache for port 63bacab4-3783-4ad9-8076-c90b88f0d3fc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89768d88-6143-4258-8946-695a455ae27e req-911a55ab-692c-42f1-baf7-803530191cf7 service nova] Releasing lock "refresh_cache-8263a95b-fe6a-45c8-a94e-dccd6ec5f623" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "af36b13246a2ed571292a301dac09b8cf761601f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.693s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "af36b13246a2ed571292a301dac09b8cf761601f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "af36b13246a2ed571292a301dac09b8cf761601f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f,backing_fmt=raw /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f,backing_fmt=raw /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk 1073741824" returned: 0 in 0.049s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "af36b13246a2ed571292a301dac09b8cf761601f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'migration_context' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Rebasing disk image.
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a -F raw /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a -F raw /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk" returned: 0 in 1.920s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Ensure instance console log exists: /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Start _get_guest_xml network_info=[{"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e8a619ed7a22ddedad87cdebafac5813',container_format='bare',created_at=2023-08-16T15:08:22Z,direct_url=<?>,disk_format='qcow2',id=775551e7-f243-4304-934d-b40d1268022b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1432407467-shelved',owner='0c198a130ace46eca27de708de492ef7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T15:08:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '034ec9ce-a006-4147-92e1-eb7d705f4626', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTVkZKxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8263a95b-fe6a-45c8-a94e-dccd6ec5f623', 'attached_at': '', 'detached_at': '', 'volume_id': '15f8e5c1-0fe8-4a34-8dcf-3fc925037d67', 'serial': '15f8e5c1-0fe8-4a34-8dcf-3fc925037d67'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:10:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:10:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e8a619ed7a22ddedad87cdebafac5813',container_format='bare',created_at=2023-08-16T15:08:22Z,direct_url=<?>,disk_format='qcow2',id=775551e7-f243-4304-934d-b40d1268022b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1432407467-shelved',owner='0c198a130ace46eca27de708de492ef7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T15:08:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTVkZKxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:10:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:10:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:10:33 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed28a7-074f-4f45-ae95-2f1125f80507]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:10:33 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f7b869-c032-47f3-9fd8-4bb12ecf61fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67] added
Aug 16 15:10:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[278ed2d3-90d0-43c2-b43d-8ef66c6e9325]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518378e-2aae-4807-a403-7374b41dbe47]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTVkZKxb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTVkZKxb" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb1688-3183-4410-9ea9-8e22940cb8ba]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RTVkZKxb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a414b24-b333-4da9-96c3-220976b2053a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db246399-df1b-4690-94a5-acd3c4af55b0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d10279-a5d8-4912-a22b-5b76c512dcea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260]
Aug 16 15:10:33 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260] successful.
Aug 16 15:10:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843c81c-6e41-472d-89fe-d1ffc6f37466]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a5f577-e0ad-4b57-a3ed-917dba37b22c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:33 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:10:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:33 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:10:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91663142-ef1b-4103-9647-e5f698861415]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:10:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTVkZKxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198619.3986058, 99360337-b6a6-46d0-b65a-b67441b0c4d9 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] VM Stopped (Lifecycle Event)
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b92050e8-2ead-4d00-b472-ac768842ace1 None None] [instance: 99360337-b6a6-46d0-b65a-b67441b0c4d9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26333626237346661', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333626237346661', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1432407467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1432407467',id=20,image_ref='775551e7-f243-4304-934d-b40d1268022b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1998158073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-1lqullfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member',shelved_at='2023-08-16T15:08:27.499378',shelved_host='user',shelved_image_id='775551e7-f243-4304-934d-b40d1268022b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=8263a95b-fe6a-45c8-a94e-dccd6ec5f623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'pci_devices' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:10:34 user nova-compute[73091]:   <uuid>8263a95b-fe6a-45c8-a94e-dccd6ec5f623</uuid>
Aug 16 15:10:34 user nova-compute[73091]:   <name>instance-00000014</name>
Aug 16 15:10:34 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:10:34 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:10:34 user nova-compute[73091]:   <metadata>
Aug 16 15:10:34 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:10:34 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:10:34 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1432407467</nova:name>
Aug 16 15:10:34 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:10:33</nova:creationTime>
Aug 16 15:10:34 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:10:34 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:10:34 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:10:34 user nova-compute[73091]:       <nova:owner>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:user uuid="0f6775ee1ca44360920397fd8bbf2899">tempest-AttachVolumeShelveTestJSON-1996332630-project-member</nova:user>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:project uuid="0c198a130ace46eca27de708de492ef7">tempest-AttachVolumeShelveTestJSON-1996332630</nova:project>
Aug 16 15:10:34 user nova-compute[73091]:       </nova:owner>
Aug 16 15:10:34 user nova-compute[73091]:       <nova:root type="image" uuid="775551e7-f243-4304-934d-b40d1268022b"/>
Aug 16 15:10:34 user nova-compute[73091]:       <nova:ports>
Aug 16 15:10:34 user nova-compute[73091]:         <nova:port uuid="63bacab4-3783-4ad9-8076-c90b88f0d3fc">
Aug 16 15:10:34 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:10:34 user nova-compute[73091]:         </nova:port>
Aug 16 15:10:34 user nova-compute[73091]:       </nova:ports>
Aug 16 15:10:34 user nova-compute[73091]:     </nova:instance>
Aug 16 15:10:34 user nova-compute[73091]:   </metadata>
Aug 16 15:10:34 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:10:34 user nova-compute[73091]:     <system>
Aug 16 15:10:34 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:10:34 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:10:34 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:10:34 user nova-compute[73091]:       <entry name="serial">8263a95b-fe6a-45c8-a94e-dccd6ec5f623</entry>
Aug 16 15:10:34 user nova-compute[73091]:       <entry name="uuid">8263a95b-fe6a-45c8-a94e-dccd6ec5f623</entry>
Aug 16 15:10:34 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:10:34 user nova-compute[73091]:     </system>
Aug 16 15:10:34 user nova-compute[73091]:   </sysinfo>
Aug 16 15:10:34 user nova-compute[73091]:   <os>
Aug 16 15:10:34 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:10:34 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:10:34 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:10:34 user nova-compute[73091]:   </os>
Aug 16 15:10:34 user nova-compute[73091]:   <features>
Aug 16 15:10:34 user nova-compute[73091]:     <acpi/>
Aug 16 15:10:34 user nova-compute[73091]:     <apic/>
Aug 16 15:10:34 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:10:34 user nova-compute[73091]:   </features>
Aug 16 15:10:34 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:10:34 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:10:34 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:10:34 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:10:34 user nova-compute[73091]:   </clock>
Aug 16 15:10:34 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:10:34 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:10:34 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:10:34 user nova-compute[73091]:   </cpu>
Aug 16 15:10:34 user nova-compute[73091]:   <devices>
Aug 16 15:10:34 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:10:34 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:10:34 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk"/>
Aug 16 15:10:34 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:10:34 user nova-compute[73091]:     </disk>
Aug 16 15:10:34 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:10:34 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:10:34 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:10:34 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 15:10:34 user nova-compute[73091]:       <serial>15f8e5c1-0fe8-4a34-8dcf-3fc925037d67</serial>
Aug 16 15:10:34 user nova-compute[73091]:     </disk>
Aug 16 15:10:34 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:10:34 user nova-compute[73091]:       <mac address="fa:16:3e:7f:7e:73"/>
Aug 16 15:10:34 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:10:34 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:10:34 user nova-compute[73091]:       <target dev="tap63bacab4-37"/>
Aug 16 15:10:34 user nova-compute[73091]:     </interface>
Aug 16 15:10:34 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:10:34 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/console.log" append="off"/>
Aug 16 15:10:34 user nova-compute[73091]:     </serial>
Aug 16 15:10:34 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:10:34 user nova-compute[73091]:     <video>
Aug 16 15:10:34 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:10:34 user nova-compute[73091]:     </video>
Aug 16 15:10:34 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:10:34 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:10:34 user nova-compute[73091]:     </rng>
Aug 16 15:10:34 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:10:34 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:10:34 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:10:34 user nova-compute[73091]:     </memballoon>
Aug 16 15:10:34 user nova-compute[73091]:   </devices>
Aug 16 15:10:34 user nova-compute[73091]: </domain>
Aug 16 15:10:34 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1432407467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1432407467',id=20,image_ref='775551e7-f243-4304-934d-b40d1268022b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1998158073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-1lqullfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member',shelved_at='2023-08-16T15:08:27.499378',shelved_host='user',shelved_image_id='775551e7-f243-4304-934d-b40d1268022b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=8263a95b-fe6a-45c8-a94e-dccd6ec5f623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG os_vif [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63bacab4-37, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63bacab4-37, col_values=(('external_ids', {'iface-id': '63bacab4-3783-4ad9-8076-c90b88f0d3fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:7e:73', 'vm-uuid': '8263a95b-fe6a-45c8-a94e-dccd6ec5f623'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:34 user nova-compute[73091]: INFO os_vif [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37')
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No VIF found with MAC fa:16:3e:7f:7e:73, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-changed-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Refreshing instance network info cache due to event network-changed-f94a19b5-a285-4efb-9931-8f26831a7382. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Refreshing network info cache for port f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-9bc5b898-6694-42a3-ba8b-64a06cc8167f req-22b6627f-76a4-44c8-a5b4-94b1c424500f service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9bc5b898-6694-42a3-ba8b-64a06cc8167f req-22b6627f-76a4-44c8-a5b4-94b1c424500f service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9bc5b898-6694-42a3-ba8b-64a06cc8167f req-22b6627f-76a4-44c8-a5b4-94b1c424500f service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9bc5b898-6694-42a3-ba8b-64a06cc8167f req-22b6627f-76a4-44c8-a5b4-94b1c424500f service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-9bc5b898-6694-42a3-ba8b-64a06cc8167f req-22b6627f-76a4-44c8-a5b4-94b1c424500f service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:36 user nova-compute[73091]: WARNING nova.compute.manager [req-9bc5b898-6694-42a3-ba8b-64a06cc8167f req-22b6627f-76a4-44c8-a5b4-94b1c424500f service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:10:36 user nova-compute[73091]: INFO nova.compute.claims [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Claim successful on node user
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updated VIF entry in instance network info cache for port f94a19b5-a285-4efb-9931-8f26831a7382. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-143a1977-8c6e-4eb3-919a-776cabc37fd5 req-e3132e07-bd14-4a82-8c0e-b35401090f15 service nova] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:10:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.policy [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceda77fdee15448c9c18cc1a1c64d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc077091084e3da6c5eba044a428bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:10:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Creating image(s)
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "224129cbf7e47ebf45cbf615ee2e6f4a706cb524" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "224129cbf7e47ebf45cbf615ee2e6f4a706cb524" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.part --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.virt.images [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] 7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.part /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Successfully created port: 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.part /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.converted" returned: 0 in 0.168s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "224129cbf7e47ebf45cbf615ee2e6f4a706cb524" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "224129cbf7e47ebf45cbf615ee2e6f4a706cb524" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "224129cbf7e47ebf45cbf615ee2e6f4a706cb524" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-790aa916-e49d-4b58-893c-c0967f51b7c9 req-b8ead074-be7f-49af-ac7c-4ffea31dc524 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-790aa916-e49d-4b58-893c-c0967f51b7c9 req-b8ead074-be7f-49af-ac7c-4ffea31dc524 service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-790aa916-e49d-4b58-893c-c0967f51b7c9 req-b8ead074-be7f-49af-ac7c-4ffea31dc524 service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-790aa916-e49d-4b58-893c-c0967f51b7c9 req-b8ead074-be7f-49af-ac7c-4ffea31dc524 service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-790aa916-e49d-4b58-893c-c0967f51b7c9 req-b8ead074-be7f-49af-ac7c-4ffea31dc524 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:38 user nova-compute[73091]: WARNING nova.compute.manager [req-790aa916-e49d-4b58-893c-c0967f51b7c9 req-b8ead074-be7f-49af-ac7c-4ffea31dc524 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198638.6414142, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] VM Resumed (Lifecycle Event)
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:10:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance spawned successfully.
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:10:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198638.653962, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] VM Started (Lifecycle Event)
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:10:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524,backing_fmt=raw /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524,backing_fmt=raw /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk 1073741824" returned: 0 in 0.055s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "224129cbf7e47ebf45cbf615ee2e6f4a706cb524" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Successfully updated port: 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing instance network info cache due to event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2de29dbb-64f7-49d9-b7a7-33c2fd49230f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.594s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1ec8a8d3-a5ac-4371-8879-f7b235ed2101 req-75d84915-a2d6-4d95-9efb-abe2b1c6f20c service nova] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Cannot resize image /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'migration_context' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Ensure instance console log exists: /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:39 user nova-compute[73091]: INFO nova.compute.manager [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] instance snapshotting
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Beginning live snapshot process
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance network_info: |[{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Start _get_guest_xml network_info=[{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T15:10:33Z,direct_url=<?>,disk_format='qcow2',id=7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd,min_disk=0,min_ram=0,name='tempest-scenario-img--653961032',owner='eccc077091084e3da6c5eba044a428bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T15:10:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:10:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:10:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T15:10:33Z,direct_url=<?>,disk_format='qcow2',id=7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd,min_disk=0,min_ram=0,name='tempest-scenario-img--653961032',owner='eccc077091084e3da6c5eba044a428bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T15:10:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638607342',display_name='tempest-TestMinimumBasicScenario-server-1638607342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638607342',id=27,image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKedjQhiPAMOu3U+iG2SKYrvhmX9Dtktr6EkdHGsqnbuJIWesNok+5qdq5FnXXNXNAey6PPPcUZ9yAuEjiKBULfrO/tYJkZzzU6dQfQZvYtSVkZMjHTmWs+sFalApouOAA==',key_name='tempest-TestMinimumBasicScenario-1184341503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-tgbq8n5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:10:37Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=b7d8df62-ad41-488e-9612-287fee103229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'pci_devices' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:10:39 user nova-compute[73091]:   <uuid>b7d8df62-ad41-488e-9612-287fee103229</uuid>
Aug 16 15:10:39 user nova-compute[73091]:   <name>instance-0000001b</name>
Aug 16 15:10:39 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:10:39 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:10:39 user nova-compute[73091]:   <metadata>
Aug 16 15:10:39 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:10:39 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:10:39 user nova-compute[73091]:       <nova:name>tempest-TestMinimumBasicScenario-server-1638607342</nova:name>
Aug 16 15:10:39 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:10:39</nova:creationTime>
Aug 16 15:10:39 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:10:39 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:10:39 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:10:39 user nova-compute[73091]:       <nova:owner>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:user uuid="ceda77fdee15448c9c18cc1a1c64d0fb">tempest-TestMinimumBasicScenario-1639423549-project-member</nova:user>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:project uuid="eccc077091084e3da6c5eba044a428bd">tempest-TestMinimumBasicScenario-1639423549</nova:project>
Aug 16 15:10:39 user nova-compute[73091]:       </nova:owner>
Aug 16 15:10:39 user nova-compute[73091]:       <nova:root type="image" uuid="7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd"/>
Aug 16 15:10:39 user nova-compute[73091]:       <nova:ports>
Aug 16 15:10:39 user nova-compute[73091]:         <nova:port uuid="56ae74d8-0d8d-4492-80a2-174d2c2d85f1">
Aug 16 15:10:39 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 15:10:39 user nova-compute[73091]:         </nova:port>
Aug 16 15:10:39 user nova-compute[73091]:       </nova:ports>
Aug 16 15:10:39 user nova-compute[73091]:     </nova:instance>
Aug 16 15:10:39 user nova-compute[73091]:   </metadata>
Aug 16 15:10:39 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:10:39 user nova-compute[73091]:     <system>
Aug 16 15:10:39 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:10:39 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:10:39 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:10:39 user nova-compute[73091]:       <entry name="serial">b7d8df62-ad41-488e-9612-287fee103229</entry>
Aug 16 15:10:39 user nova-compute[73091]:       <entry name="uuid">b7d8df62-ad41-488e-9612-287fee103229</entry>
Aug 16 15:10:39 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:10:39 user nova-compute[73091]:     </system>
Aug 16 15:10:39 user nova-compute[73091]:   </sysinfo>
Aug 16 15:10:39 user nova-compute[73091]:   <os>
Aug 16 15:10:39 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:10:39 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:10:39 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:10:39 user nova-compute[73091]:   </os>
Aug 16 15:10:39 user nova-compute[73091]:   <features>
Aug 16 15:10:39 user nova-compute[73091]:     <acpi/>
Aug 16 15:10:39 user nova-compute[73091]:     <apic/>
Aug 16 15:10:39 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:10:39 user nova-compute[73091]:   </features>
Aug 16 15:10:39 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:10:39 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:10:39 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:10:39 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:10:39 user nova-compute[73091]:   </clock>
Aug 16 15:10:39 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:10:39 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:10:39 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:10:39 user nova-compute[73091]:   </cpu>
Aug 16 15:10:39 user nova-compute[73091]:   <devices>
Aug 16 15:10:39 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:10:39 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:10:39 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk"/>
Aug 16 15:10:39 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:10:39 user nova-compute[73091]:     </disk>
Aug 16 15:10:39 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:10:39 user nova-compute[73091]:       <mac address="fa:16:3e:b0:f8:d9"/>
Aug 16 15:10:39 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:10:39 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:10:39 user nova-compute[73091]:       <target dev="tap56ae74d8-0d"/>
Aug 16 15:10:39 user nova-compute[73091]:     </interface>
Aug 16 15:10:39 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:10:39 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/console.log" append="off"/>
Aug 16 15:10:39 user nova-compute[73091]:     </serial>
Aug 16 15:10:39 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:10:39 user nova-compute[73091]:     <video>
Aug 16 15:10:39 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:10:39 user nova-compute[73091]:     </video>
Aug 16 15:10:39 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:10:39 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:10:39 user nova-compute[73091]:     </rng>
Aug 16 15:10:39 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:10:39 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:10:39 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:10:39 user nova-compute[73091]:     </memballoon>
Aug 16 15:10:39 user nova-compute[73091]:   </devices>
Aug 16 15:10:39 user nova-compute[73091]: </domain>
Aug 16 15:10:39 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638607342',display_name='tempest-TestMinimumBasicScenario-server-1638607342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638607342',id=27,image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKedjQhiPAMOu3U+iG2SKYrvhmX9Dtktr6EkdHGsqnbuJIWesNok+5qdq5FnXXNXNAey6PPPcUZ9yAuEjiKBULfrO/tYJkZzzU6dQfQZvYtSVkZMjHTmWs+sFalApouOAA==',key_name='tempest-TestMinimumBasicScenario-1184341503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-tgbq8n5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:10:37Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=b7d8df62-ad41-488e-9612-287fee103229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG os_vif [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56ae74d8-0d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56ae74d8-0d, col_values=(('external_ids', {'iface-id': '56ae74d8-0d8d-4492-80a2-174d2c2d85f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f8:d9', 'vm-uuid': 'b7d8df62-ad41-488e-9612-287fee103229'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:39 user nova-compute[73091]: INFO os_vif [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d')
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No VIF found with MAC fa:16:3e:b0:f8:d9, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpubh1893j/b95cd157d679499b91fad82639cfa000.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpubh1893j/b95cd157d679499b91fad82639cfa000.delta 1073741824" returned: 0 in 0.056s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 15:10:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:10:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] COPY block job progress, current cursor: 25559040 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-c50c8eac-204d-4f7b-b993-ef33037660f0 req-0ab0c94f-7d92-43d3-a97e-8e0c26b86b59 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c50c8eac-204d-4f7b-b993-ef33037660f0 req-0ab0c94f-7d92-43d3-a97e-8e0c26b86b59 service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c50c8eac-204d-4f7b-b993-ef33037660f0 req-0ab0c94f-7d92-43d3-a97e-8e0c26b86b59 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c50c8eac-204d-4f7b-b993-ef33037660f0 req-0ab0c94f-7d92-43d3-a97e-8e0c26b86b59 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-c50c8eac-204d-4f7b-b993-ef33037660f0 req-0ab0c94f-7d92-43d3-a97e-8e0c26b86b59 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:42 user nova-compute[73091]: WARNING nova.compute.manager [req-c50c8eac-204d-4f7b-b993-ef33037660f0 req-0ab0c94f-7d92-43d3-a97e-8e0c26b86b59 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state building and task_state spawning.
Aug 16 15:10:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:10:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 15:10:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpubh1893j/b95cd157d679499b91fad82639cfa000.delta /opt/stack/data/nova/instances/snapshots/tmpubh1893j/b95cd157d679499b91fad82639cfa000 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpubh1893j/b95cd157d679499b91fad82639cfa000.delta /opt/stack/data/nova/instances/snapshots/tmpubh1893j/b95cd157d679499b91fad82639cfa000" returned: 0 in 0.382s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Snapshot extracted, beginning image upload
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing instance network info cache due to event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'flavor' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:43 user nova-compute[73091]: INFO nova.compute.manager [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Attaching volume 04b12214-8d09-49c4-be7f-def27f1e3e67 to /dev/vdb
Aug 16 15:10:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updated VIF entry in instance network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2fbcea-757f-47b0-953c-e300c8364216]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e0f0856-7acf-4361-a78f-23fc703fcc46 req-339640fa-a2c8-461f-8903-ccfa05c7a702 service nova] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fba754-3050-43c1-be60-e969c93df553]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1db45e9-d54c-4faf-b61d-09d01ecf51f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a7f5a8-8da0-4037-ba29-8909ddb23f38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:10:43 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:10:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444dff5-8ac7-4d72-a7b9-4e9777f2c169]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:10:43 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating existing volume attachment record: 041ef41c-c5b4-41a3-86f0-049817f1fee4 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f2af118-512f-4e94-afea-0be7ef901c62 req-8ee343bc-615c-4e27-9406-e4d3b4993116 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f2af118-512f-4e94-afea-0be7ef901c62 req-8ee343bc-615c-4e27-9406-e4d3b4993116 service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f2af118-512f-4e94-afea-0be7ef901c62 req-8ee343bc-615c-4e27-9406-e4d3b4993116 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f2af118-512f-4e94-afea-0be7ef901c62 req-8ee343bc-615c-4e27-9406-e4d3b4993116 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f2af118-512f-4e94-afea-0be7ef901c62 req-8ee343bc-615c-4e27-9406-e4d3b4993116 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:10:44 user nova-compute[73091]: WARNING nova.compute.manager [req-4f2af118-512f-4e94-afea-0be7ef901c62 req-8ee343bc-615c-4e27-9406-e4d3b4993116 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state building and task_state spawning.
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198644.4973855, b7d8df62-ad41-488e-9612-287fee103229 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] VM Resumed (Lifecycle Event)
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance spawned successfully.
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198644.498705, b7d8df62-ad41-488e-9612-287fee103229 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] VM Started (Lifecycle Event)
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Took 7.32 seconds to spawn the instance on the hypervisor.
Aug 16 15:10:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:10:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:44 user nova-compute[73091]: INFO nova.compute.manager [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Took 8.13 seconds to build instance.
Aug 16 15:10:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e82bfdbd-76c1-4e75-b9b2-de560d85d239 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.270s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Snapshot image upload complete
Aug 16 15:10:45 user nova-compute[73091]: INFO nova.compute.manager [None req-7f7b62fd-1b76-40a6-a103-2d2900c1757d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Took 6.18 seconds to snapshot the instance on the hypervisor.
Aug 16 15:10:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:10:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moIkDOJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:10:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:10:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:10:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:10:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:10:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:10:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:10:55 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00a286-b64e-4405-ac91-83478fd6a638]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:10:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734d5c4-3d5c-4567-815c-f097e6d8d8ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67] added
Aug 16 15:10:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb00506-32e1-47d0-a090-3bf969350300]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[475d6d9b-d8e1-4f3c-8ac6-e713c66e0c11]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moIkDOJb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moIkDOJb" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5c7715-106b-4cad-931d-8a3db68e1ae2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moIkDOJb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1d857-1edc-48e6-91ff-fa2e68ba4612]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb332888-1f80-4c0f-a941-1534fae0de0c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:56 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:10:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:56 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:10:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27297405-9e64-48ae-b4bc-cc450af65d57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260]
Aug 16 15:10:56 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:10:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda381e-9b6f-4479-bf04-eab9ac0dcedc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[110828d3-237d-4528-9993-ab72cdb37578]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:56 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:10:56 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:10:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:10:56 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:10:56 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:10:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ab5f4-1a52-4b37-81d4-e012697a97d6]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moIkDOJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:10:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:10:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26432653639393165', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:10:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432653639393165', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:10:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'flavor' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:10:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:10:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:10:57 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:10:57 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:10:57 user nova-compute[73091]:   <serial>04b12214-8d09-49c4-be7f-def27f1e3e67</serial>
Aug 16 15:10:57 user nova-compute[73091]: </disk>
Aug 16 15:10:57 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:10:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:10:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:10:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:10:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:9d:35:5f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:10:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4db1040-3915-43cf-9291-562689e7f75e tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.811s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:10:59 user nova-compute[73091]: INFO nova.compute.manager [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Rescuing
Aug 16 15:10:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:10:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:10:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:10:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-53003400-8dea-4d22-b98c-02701c99420d req-bee4211d-6354-4f17-9abc-d24629c8dd41 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53003400-8dea-4d22-b98c-02701c99420d req-bee4211d-6354-4f17-9abc-d24629c8dd41 service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53003400-8dea-4d22-b98c-02701c99420d req-bee4211d-6354-4f17-9abc-d24629c8dd41 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53003400-8dea-4d22-b98c-02701c99420d req-bee4211d-6354-4f17-9abc-d24629c8dd41 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-53003400-8dea-4d22-b98c-02701c99420d req-bee4211d-6354-4f17-9abc-d24629c8dd41 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:01 user nova-compute[73091]: WARNING nova.compute.manager [req-53003400-8dea-4d22-b98c-02701c99420d req-bee4211d-6354-4f17-9abc-d24629c8dd41 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state active and task_state rescuing.
Aug 16 15:11:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance destroyed successfully.
Aug 16 15:11:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Attempting rescue
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:11:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Creating image(s)
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'migration_context' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Start _get_guest_xml network_info=[{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:9d:35:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'resources' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'numa_topology' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920729177',display_name='tempest-ServerRescueNegativeTestJSON-server-920729177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920729177',id=25,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFrlhy1Sn18rFziQLvR7ck0OWZ0Nn3+QEeu842U/5Tb41Xo+utkGsudC70oKMuV5erO3jTN73jNOYID0yIThT3L/ST2g1Hsf3ILwdV+oy4rBykFqhsETxawdFd9JZlxuQ==',key_name='tempest-keypair-1819551141',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-qt2chcaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=86f25d04-d425-4fcb-b502-f9d0ddee8b6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:9d:35:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "vif_mac": "fa:16:3e:9d:35:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'pci_devices' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:11:01 user nova-compute[73091]:   <uuid>86f25d04-d425-4fcb-b502-f9d0ddee8b6f</uuid>
Aug 16 15:11:01 user nova-compute[73091]:   <name>instance-00000019</name>
Aug 16 15:11:01 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:11:01 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:11:01 user nova-compute[73091]:   <metadata>
Aug 16 15:11:01 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:11:01 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:11:01 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-920729177</nova:name>
Aug 16 15:11:01 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:11:01</nova:creationTime>
Aug 16 15:11:01 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:11:01 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:11:01 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:11:01 user nova-compute[73091]:       <nova:owner>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:user uuid="9348c14ed1dc496ebf20d26e3b31779a">tempest-ServerRescueNegativeTestJSON-789793483-project-member</nova:user>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:project uuid="4cabeffd95264d63aa6802f8a91387e9">tempest-ServerRescueNegativeTestJSON-789793483</nova:project>
Aug 16 15:11:01 user nova-compute[73091]:       </nova:owner>
Aug 16 15:11:01 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:11:01 user nova-compute[73091]:       <nova:ports>
Aug 16 15:11:01 user nova-compute[73091]:         <nova:port uuid="d6c4e4b6-5546-4221-8ec4-67a554f5c00d">
Aug 16 15:11:01 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 15:11:01 user nova-compute[73091]:         </nova:port>
Aug 16 15:11:01 user nova-compute[73091]:       </nova:ports>
Aug 16 15:11:01 user nova-compute[73091]:     </nova:instance>
Aug 16 15:11:01 user nova-compute[73091]:   </metadata>
Aug 16 15:11:01 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:11:01 user nova-compute[73091]:     <system>
Aug 16 15:11:01 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:11:01 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:11:01 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:11:01 user nova-compute[73091]:       <entry name="serial">86f25d04-d425-4fcb-b502-f9d0ddee8b6f</entry>
Aug 16 15:11:01 user nova-compute[73091]:       <entry name="uuid">86f25d04-d425-4fcb-b502-f9d0ddee8b6f</entry>
Aug 16 15:11:01 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:11:01 user nova-compute[73091]:     </system>
Aug 16 15:11:01 user nova-compute[73091]:   </sysinfo>
Aug 16 15:11:01 user nova-compute[73091]:   <os>
Aug 16 15:11:01 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:11:01 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:11:01 user nova-compute[73091]:   </os>
Aug 16 15:11:01 user nova-compute[73091]:   <features>
Aug 16 15:11:01 user nova-compute[73091]:     <acpi/>
Aug 16 15:11:01 user nova-compute[73091]:     <apic/>
Aug 16 15:11:01 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:11:01 user nova-compute[73091]:   </features>
Aug 16 15:11:01 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:11:01 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:11:01 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:11:01 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:11:01 user nova-compute[73091]:   </clock>
Aug 16 15:11:01 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:11:01 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:11:01 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:11:01 user nova-compute[73091]:   </cpu>
Aug 16 15:11:01 user nova-compute[73091]:   <devices>
Aug 16 15:11:01 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:11:01 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:11:01 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue"/>
Aug 16 15:11:01 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:11:01 user nova-compute[73091]:     </disk>
Aug 16 15:11:01 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:11:01 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:11:01 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk"/>
Aug 16 15:11:01 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:11:01 user nova-compute[73091]:     </disk>
Aug 16 15:11:01 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:11:01 user nova-compute[73091]:       <mac address="fa:16:3e:9d:35:5f"/>
Aug 16 15:11:01 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:11:01 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:11:01 user nova-compute[73091]:       <target dev="tapd6c4e4b6-55"/>
Aug 16 15:11:01 user nova-compute[73091]:     </interface>
Aug 16 15:11:01 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:11:01 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/console.log" append="off"/>
Aug 16 15:11:01 user nova-compute[73091]:     </serial>
Aug 16 15:11:01 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:11:01 user nova-compute[73091]:     <video>
Aug 16 15:11:01 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:11:01 user nova-compute[73091]:     </video>
Aug 16 15:11:01 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:11:01 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:11:01 user nova-compute[73091]:     </rng>
Aug 16 15:11:01 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:11:01 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:11:01 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:11:01 user nova-compute[73091]:     </memballoon>
Aug 16 15:11:01 user nova-compute[73091]:   </devices>
Aug 16 15:11:01 user nova-compute[73091]: </domain>
Aug 16 15:11:01 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:11:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance destroyed successfully.
Aug 16 15:11:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:11:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:11:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] No VIF found with MAC fa:16:3e:9d:35:5f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:11:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-15fee521-a915-450c-923c-e177e37185c0 req-d382b44a-f3d6-48f5-99db-063605042dc3 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15fee521-a915-450c-923c-e177e37185c0 req-d382b44a-f3d6-48f5-99db-063605042dc3 service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15fee521-a915-450c-923c-e177e37185c0 req-d382b44a-f3d6-48f5-99db-063605042dc3 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15fee521-a915-450c-923c-e177e37185c0 req-d382b44a-f3d6-48f5-99db-063605042dc3 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-15fee521-a915-450c-923c-e177e37185c0 req-d382b44a-f3d6-48f5-99db-063605042dc3 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:03 user nova-compute[73091]: WARNING nova.compute.manager [req-15fee521-a915-450c-923c-e177e37185c0 req-d382b44a-f3d6-48f5-99db-063605042dc3 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state active and task_state rescuing.
Aug 16 15:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:05 user nova-compute[73091]: WARNING nova.compute.manager [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state active and task_state rescuing.
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:05 user nova-compute[73091]: WARNING nova.compute.manager [req-fd50ad4e-29ef-4563-8e1e-44ef5d0c57d4 req-1fb3bd81-a3f1-4097-84de-d848a729229f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state active and task_state rescuing.
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for 86f25d04-d425-4fcb-b502-f9d0ddee8b6f due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198665.8128827, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:11:05 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Resumed (Lifecycle Event)
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-862973c0-4358-42de-b3d5-3e34055a4340 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:11:05 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198665.8161678, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:11:05 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Started (Lifecycle Event)
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:11 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:11 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7266MB free_disk=25.28329086303711GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7d8df62-ad41-488e-9612-287fee103229 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:11:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.966s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:11:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:11:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:11:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-changed-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Refreshing instance network info cache due to event network-changed-e965c54c-3553-4055-946d-90c0a9225618. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] Acquiring lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] Acquired lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Refreshing network info cache for port e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'flavor' on Instance uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:27 user nova-compute[73091]: INFO nova.compute.manager [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Attaching volume 7830e986-c227-4b74-91f6-dd0afaa11563 to /dev/vdb
Aug 16 15:11:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db6ccd-ec9b-4535-9307-1a4eb68f5be4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8019fb04-ded3-4b1a-89e0-a67e80516c65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0095304-1737-4495-8db6-e344897519bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb88cea-128d-406c-b91c-b48fb71d51cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:11:27 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f30f6-a126-48b1-9b3e-3ba149bdb269]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating existing volume attachment record: 292869bd-98ec-4efc-8f9a-e2c25264994e {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updated VIF entry in instance network info cache for port e965c54c-3553-4055-946d-90c0a9225618. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating instance_info_cache with network_info: [{"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-19545d94-1a63-49c1-aa53-0bb6bdbb6ea4 req-a99977c0-aec6-45ce-a5f3-df298b00d43d service nova] Releasing lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVEwWdUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:11:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:11:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:11:38 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f1f342-ab08-48dd-90f2-0398b5b66f2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:11:38 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef6778-3223-44ef-a725-d18ddf395319]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563] added
Aug 16 15:11:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f8ed2f-b851-42ea-a236-49881a32beb2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d5760b-7dd9-4868-8923-e4f977eccc78]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVEwWdUk {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVEwWdUk" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9916ba07-7fa9-484c-b699-a55d6e16b05d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVEwWdUk'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6d566b-fb2e-4983-ae53-6f5d66600a3b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68c19b-54e3-4de6-9c81-b45d9fd0581a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2b567-4c77-4569-a77b-57dd65697709]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260]
Aug 16 15:11:39 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260] successful.
Aug 16 15:11:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39ce1c0-9ba4-4fe2-a07b-1b47b2bc0b3a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11a974-2022-40d4-9488-75ec8b5d518d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 (non-flash)
Aug 16 15:11:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed2f921-cb4c-43ea-977a-02ab7dc3b091]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:11:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVEwWdUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23737653565653463', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737653565653463', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'flavor' on Instance uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:11:40 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:11:40 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:11:40 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:11:40 user nova-compute[73091]:   <serial>7830e986-c227-4b74-91f6-dd0afaa11563</serial>
Aug 16 15:11:40 user nova-compute[73091]: </disk>
Aug 16 15:11:40 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No VIF found with MAC fa:16:3e:bb:d7:03, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6a348e1a-b4f6-40a1-8c84-5a15bce5f3c4 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.783s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:43 user nova-compute[73091]: INFO nova.compute.manager [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Detaching volume 7830e986-c227-4b74-91f6-dd0afaa11563
Aug 16 15:11:43 user nova-compute[73091]: INFO nova.virt.block_device [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Attempting to driver detach volume 7830e986-c227-4b74-91f6-dd0afaa11563 from mountpoint /dev/vdb
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Attempting to detach device vdb from instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:11:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:11:43 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:11:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:11:43 user nova-compute[73091]:   <serial>7830e986-c227-4b74-91f6-dd0afaa11563</serial>
Aug 16 15:11:43 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:11:43 user nova-compute[73091]: </disk>
Aug 16 15:11:43 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:11:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully detached device vdb from instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 from the persistent domain config.
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:11:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:11:43 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:11:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:11:43 user nova-compute[73091]:   <serial>7830e986-c227-4b74-91f6-dd0afaa11563</serial>
Aug 16 15:11:43 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:11:43 user nova-compute[73091]: </disk>
Aug 16 15:11:43 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198703.6972919, fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:11:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully detached device vdb from instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 from the live domain config.
Aug 16 15:11:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVEwWdUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:11:43 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0348e115-3d1e-44cc-af36-98fa402cc3c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd7682-d9bb-4c46-944e-4bfd56218bed]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:11:43 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:11:43 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:11:43 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 (non-flash)
Aug 16 15:11:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:11:43 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:11:43 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:11:43 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 (non-flash)
Aug 16 15:11:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c3a9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca62db8-54b1-49d5-9d50-c73c427a147c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e78116-a698-4d92-9fc4-c141b5661312]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8242a79-82eb-4155-8d92-1b809da34107]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f39aee-0842-4def-87e2-7e86eabd6127]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[134355f5-6e17-4f88-8ea5-40cb55cb8537]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cee296-9005-4431-a512-1742924f7ec5]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260]
Aug 16 15:11:44 user nova-compute[73091]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563, portal: 172.16.0.220,3260] successful.
Aug 16 15:11:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7830e986-c227-4b74-91f6-dd0afaa11563 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61a6fa1-166e-44eb-ae62-52944265c043]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] <== disconnect_volume: return (330ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'flavor' on Instance uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e3513ed-e675-41cb-963e-d1b33f31c095 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:11:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:11:45 user nova-compute[73091]: INFO nova.compute.claims [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Claim successful on node user
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:11:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.policy [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58ba771d2c1c4164aac60e2f80ce7e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c654508f7acb4bc2b690668cfe19522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:11:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Creating image(s)
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "/opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "/opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Successfully created port: 64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Cannot resize image /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'migration_context' on Instance uuid 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Ensure instance console log exists: /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:11:47 user nova-compute[73091]: INFO nova.compute.claims [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Claim successful on node user
Aug 16 15:11:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:11:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:11:47 user nova-compute[73091]: DEBUG nova.policy [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2d62bdb5214893859265efcf7daaea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a7f88e03d645cba7080becd3f2ca41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:11:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Creating image(s)
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "/opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "/opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "/opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Successfully updated port: 64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquired lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-changed-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Refreshing instance network info cache due to event network-changed-64727212-d669-4510-b13d-3727fc797a2e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] Acquiring lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk 1073741824" returned: 0 in 0.054s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updating instance_info_cache with network_info: [{"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Releasing lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Instance network_info: |[{"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] Acquired lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Refreshing network info cache for port 64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Start _get_guest_xml network_info=[{"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Successfully created port: f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:11:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1328268220',display_name='tempest-VolumesSnapshotTestJSON-instance-1328268220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1328268220',id=28,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoEOLo+TUmg77EArTHK3Lf4XkFQQNMrSHeXAPt1fQKxGcAJSXlG8WRgkaP6iyNmkfRlW1MlaAHNd1u75IBWy3snrxQMFR/YB4KZJT41RHPRLGjnyZPs7LzuAswsp70fgw==',key_name='tempest-keypair-1043643829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c654508f7acb4bc2b690668cfe19522d',ramdisk_id='',reservation_id='r-q53t0f1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-903677429',owner_user_name='tempest-VolumesSnapshotTestJSON-903677429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ba771d2c1c4164aac60e2f80ce7e77',uuid=9a040d49-3d4e-4496-b546-2daf1bf56978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converting VIF {"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:11:48 user nova-compute[73091]:   <uuid>9a040d49-3d4e-4496-b546-2daf1bf56978</uuid>
Aug 16 15:11:48 user nova-compute[73091]:   <name>instance-0000001c</name>
Aug 16 15:11:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:11:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:11:48 user nova-compute[73091]:   <metadata>
Aug 16 15:11:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:11:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:11:48 user nova-compute[73091]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1328268220</nova:name>
Aug 16 15:11:48 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:11:48</nova:creationTime>
Aug 16 15:11:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:11:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:11:48 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:11:48 user nova-compute[73091]:       <nova:owner>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:user uuid="58ba771d2c1c4164aac60e2f80ce7e77">tempest-VolumesSnapshotTestJSON-903677429-project-member</nova:user>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:project uuid="c654508f7acb4bc2b690668cfe19522d">tempest-VolumesSnapshotTestJSON-903677429</nova:project>
Aug 16 15:11:48 user nova-compute[73091]:       </nova:owner>
Aug 16 15:11:48 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:11:48 user nova-compute[73091]:       <nova:ports>
Aug 16 15:11:48 user nova-compute[73091]:         <nova:port uuid="64727212-d669-4510-b13d-3727fc797a2e">
Aug 16 15:11:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:11:48 user nova-compute[73091]:         </nova:port>
Aug 16 15:11:48 user nova-compute[73091]:       </nova:ports>
Aug 16 15:11:48 user nova-compute[73091]:     </nova:instance>
Aug 16 15:11:48 user nova-compute[73091]:   </metadata>
Aug 16 15:11:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:11:48 user nova-compute[73091]:     <system>
Aug 16 15:11:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:11:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:11:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:11:48 user nova-compute[73091]:       <entry name="serial">9a040d49-3d4e-4496-b546-2daf1bf56978</entry>
Aug 16 15:11:48 user nova-compute[73091]:       <entry name="uuid">9a040d49-3d4e-4496-b546-2daf1bf56978</entry>
Aug 16 15:11:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:11:48 user nova-compute[73091]:     </system>
Aug 16 15:11:48 user nova-compute[73091]:   </sysinfo>
Aug 16 15:11:48 user nova-compute[73091]:   <os>
Aug 16 15:11:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:11:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:11:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:11:48 user nova-compute[73091]:   </os>
Aug 16 15:11:48 user nova-compute[73091]:   <features>
Aug 16 15:11:48 user nova-compute[73091]:     <acpi/>
Aug 16 15:11:48 user nova-compute[73091]:     <apic/>
Aug 16 15:11:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:11:48 user nova-compute[73091]:   </features>
Aug 16 15:11:48 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:11:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:11:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:11:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:11:48 user nova-compute[73091]:   </clock>
Aug 16 15:11:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:11:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:11:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:11:48 user nova-compute[73091]:   </cpu>
Aug 16 15:11:48 user nova-compute[73091]:   <devices>
Aug 16 15:11:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:11:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:11:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk"/>
Aug 16 15:11:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:11:48 user nova-compute[73091]:     </disk>
Aug 16 15:11:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:11:48 user nova-compute[73091]:       <mac address="fa:16:3e:10:80:eb"/>
Aug 16 15:11:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:11:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:11:48 user nova-compute[73091]:       <target dev="tap64727212-d6"/>
Aug 16 15:11:48 user nova-compute[73091]:     </interface>
Aug 16 15:11:48 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:11:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/console.log" append="off"/>
Aug 16 15:11:48 user nova-compute[73091]:     </serial>
Aug 16 15:11:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:11:48 user nova-compute[73091]:     <video>
Aug 16 15:11:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:11:48 user nova-compute[73091]:     </video>
Aug 16 15:11:48 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:11:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:11:48 user nova-compute[73091]:     </rng>
Aug 16 15:11:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:11:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:11:48 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:11:48 user nova-compute[73091]:     </memballoon>
Aug 16 15:11:48 user nova-compute[73091]:   </devices>
Aug 16 15:11:48 user nova-compute[73091]: </domain>
Aug 16 15:11:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1328268220',display_name='tempest-VolumesSnapshotTestJSON-instance-1328268220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1328268220',id=28,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoEOLo+TUmg77EArTHK3Lf4XkFQQNMrSHeXAPt1fQKxGcAJSXlG8WRgkaP6iyNmkfRlW1MlaAHNd1u75IBWy3snrxQMFR/YB4KZJT41RHPRLGjnyZPs7LzuAswsp70fgw==',key_name='tempest-keypair-1043643829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c654508f7acb4bc2b690668cfe19522d',ramdisk_id='',reservation_id='r-q53t0f1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-903677429',owner_user_name='tempest-VolumesSnapshotTestJSON-903677429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ba771d2c1c4164aac60e2f80ce7e77',uuid=9a040d49-3d4e-4496-b546-2daf1bf56978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converting VIF {"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG os_vif [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64727212-d6, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64727212-d6, col_values=(('external_ids', {'iface-id': '64727212-d669-4510-b13d-3727fc797a2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:80:eb', 'vm-uuid': '9a040d49-3d4e-4496-b546-2daf1bf56978'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Cannot resize image /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lazy-loading 'migration_context' on Instance uuid 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Ensure instance console log exists: /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:48 user nova-compute[73091]: INFO os_vif [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6')
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:11:48 user nova-compute[73091]: INFO nova.compute.claims [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Claim successful on node user
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No VIF found with MAC fa:16:3e:10:80:eb, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updated VIF entry in instance network info cache for port 64727212-d669-4510-b13d-3727fc797a2e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updating instance_info_cache with network_info: [{"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1cf4b5a6-4177-467d-bf3a-8062bfa473e1 req-53d26ee3-d18b-4729-b8b1-7b1ee4b81e3e service nova] Releasing lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.751s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:11:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Successfully updated port: f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquired lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.policy [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0243ed66e484f6a820421b1f69ece02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4d07f3079144a59f93086e00017115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:11:49 user nova-compute[73091]: INFO nova.virt.block_device [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Booting with volume-backed-image b18d278d-2e25-4ef6-ba90-d1af21f699be at /dev/vda
Aug 16 15:11:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-changed-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Refreshing instance network info cache due to event network-changed-f545ab0e-caf2-473a-9102-c541e4b40bda. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] Acquiring lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updating instance_info_cache with network_info: [{"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Releasing lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Instance network_info: |[{"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] Acquired lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Refreshing network info cache for port f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Start _get_guest_xml network_info=[{"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:11:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1236672',id=29,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz4ZyjqrcrKXviakhHI5Y8o0ntt7kMW269B4axQgXI20UOmnEX+IOw4zlB/V23EqWEW0/WaexnwBaqwKg4R5l0qMW5LMIJdeKKIc9G9AZ1K6olL0iU3DG4jTEz5YGlbpg==',key_name='tempest-keypair-983592156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52a7f88e03d645cba7080becd3f2ca41',ramdisk_id='',reservation_id='r-28k4ckmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-252025234',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2d62bdb5214893859265efcf7daaea',uuid=0501f6bc-55a5-4112-9036-1f05880cdd8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Converting VIF {"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lazy-loading 'pci_devices' on Instance uuid 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:11:50 user nova-compute[73091]:   <uuid>0501f6bc-55a5-4112-9036-1f05880cdd8b</uuid>
Aug 16 15:11:50 user nova-compute[73091]:   <name>instance-0000001d</name>
Aug 16 15:11:50 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:11:50 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:11:50 user nova-compute[73091]:   <metadata>
Aug 16 15:11:50 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:11:50 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:11:50 user nova-compute[73091]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584</nova:name>
Aug 16 15:11:50 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:11:50</nova:creationTime>
Aug 16 15:11:50 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:11:50 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:11:50 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:11:50 user nova-compute[73091]:       <nova:owner>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:user uuid="4c2d62bdb5214893859265efcf7daaea">tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member</nova:user>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:project uuid="52a7f88e03d645cba7080becd3f2ca41">tempest-TestServerVolumeAttachScenarioOldVersion-252025234</nova:project>
Aug 16 15:11:50 user nova-compute[73091]:       </nova:owner>
Aug 16 15:11:50 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:11:50 user nova-compute[73091]:       <nova:ports>
Aug 16 15:11:50 user nova-compute[73091]:         <nova:port uuid="f545ab0e-caf2-473a-9102-c541e4b40bda">
Aug 16 15:11:50 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 15:11:50 user nova-compute[73091]:         </nova:port>
Aug 16 15:11:50 user nova-compute[73091]:       </nova:ports>
Aug 16 15:11:50 user nova-compute[73091]:     </nova:instance>
Aug 16 15:11:50 user nova-compute[73091]:   </metadata>
Aug 16 15:11:50 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:11:50 user nova-compute[73091]:     <system>
Aug 16 15:11:50 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:11:50 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:11:50 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:11:50 user nova-compute[73091]:       <entry name="serial">0501f6bc-55a5-4112-9036-1f05880cdd8b</entry>
Aug 16 15:11:50 user nova-compute[73091]:       <entry name="uuid">0501f6bc-55a5-4112-9036-1f05880cdd8b</entry>
Aug 16 15:11:50 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:11:50 user nova-compute[73091]:     </system>
Aug 16 15:11:50 user nova-compute[73091]:   </sysinfo>
Aug 16 15:11:50 user nova-compute[73091]:   <os>
Aug 16 15:11:50 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:11:50 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:11:50 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:11:50 user nova-compute[73091]:   </os>
Aug 16 15:11:50 user nova-compute[73091]:   <features>
Aug 16 15:11:50 user nova-compute[73091]:     <acpi/>
Aug 16 15:11:50 user nova-compute[73091]:     <apic/>
Aug 16 15:11:50 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:11:50 user nova-compute[73091]:   </features>
Aug 16 15:11:50 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:11:50 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:11:50 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:11:50 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:11:50 user nova-compute[73091]:   </clock>
Aug 16 15:11:50 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:11:50 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:11:50 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:11:50 user nova-compute[73091]:   </cpu>
Aug 16 15:11:50 user nova-compute[73091]:   <devices>
Aug 16 15:11:50 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:11:50 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:11:50 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk"/>
Aug 16 15:11:50 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:11:50 user nova-compute[73091]:     </disk>
Aug 16 15:11:50 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:11:50 user nova-compute[73091]:       <mac address="fa:16:3e:fc:10:b8"/>
Aug 16 15:11:50 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:11:50 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:11:50 user nova-compute[73091]:       <target dev="tapf545ab0e-ca"/>
Aug 16 15:11:50 user nova-compute[73091]:     </interface>
Aug 16 15:11:50 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:11:50 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/console.log" append="off"/>
Aug 16 15:11:50 user nova-compute[73091]:     </serial>
Aug 16 15:11:50 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:11:50 user nova-compute[73091]:     <video>
Aug 16 15:11:50 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:11:50 user nova-compute[73091]:     </video>
Aug 16 15:11:50 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:11:50 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:11:50 user nova-compute[73091]:     </rng>
Aug 16 15:11:50 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:11:50 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:11:50 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:11:50 user nova-compute[73091]:     </memballoon>
Aug 16 15:11:50 user nova-compute[73091]:   </devices>
Aug 16 15:11:50 user nova-compute[73091]: </domain>
Aug 16 15:11:50 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1236672',id=29,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz4ZyjqrcrKXviakhHI5Y8o0ntt7kMW269B4axQgXI20UOmnEX+IOw4zlB/V23EqWEW0/WaexnwBaqwKg4R5l0qMW5LMIJdeKKIc9G9AZ1K6olL0iU3DG4jTEz5YGlbpg==',key_name='tempest-keypair-983592156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52a7f88e03d645cba7080becd3f2ca41',ramdisk_id='',reservation_id='r-28k4ckmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-252025234',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2d62bdb5214893859265efcf7daaea',uuid=0501f6bc-55a5-4112-9036-1f05880cdd8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Converting VIF {"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG os_vif [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf545ab0e-ca, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf545ab0e-ca, col_values=(('external_ids', {'iface-id': 'f545ab0e-caf2-473a-9102-c541e4b40bda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:10:b8', 'vm-uuid': '0501f6bc-55a5-4112-9036-1f05880cdd8b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:50 user nova-compute[73091]: INFO os_vif [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca')
Aug 16 15:11:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] No VIF found with MAC fa:16:3e:fc:10:b8, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Successfully created port: e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updated VIF entry in instance network info cache for port f545ab0e-caf2-473a-9102-c541e4b40bda. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updating instance_info_cache with network_info: [{"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ade6e59a-ec70-4380-8625-9011ac2aadeb req-b83f9f64-370f-4de9-b011-d94633e56975 service nova] Releasing lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Successfully updated port: e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-changed-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Refreshing instance network info cache due to event network-changed-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] Acquiring lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] No waiting events found dispatching network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:52 user nova-compute[73091]: WARNING nova.compute.manager [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received unexpected event network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e for instance with vm_state building and task_state spawning.
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] No waiting events found dispatching network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:52 user nova-compute[73091]: WARNING nova.compute.manager [req-2fbf00f8-e0aa-44c7-90ec-1634ea8130a2 req-9498be1a-dfca-422e-8fc3-0a935cb523d0 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received unexpected event network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e for instance with vm_state building and task_state spawning.
Aug 16 15:11:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updating instance_info_cache with network_info: [{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance network_info: |[{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] Acquired lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:11:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Refreshing network info cache for port e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198713.2426267, 9a040d49-3d4e-4496-b546-2daf1bf56978 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] VM Resumed (Lifecycle Event)
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Instance spawned successfully.
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198713.2441313, 9a040d49-3d4e-4496-b546-2daf1bf56978 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] VM Started (Lifecycle Event)
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Took 7.04 seconds to spawn the instance on the hypervisor.
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:11:53 user nova-compute[73091]: INFO nova.compute.manager [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Took 7.90 seconds to build instance.
Aug 16 15:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06db5c80-bef8-4924-9d07-fbdac17a8174 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.998s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updated VIF entry in instance network info cache for port e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updating instance_info_cache with network_info: [{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99d27dfe-ddb2-44f3-9065-36e33539034d req-e6e04ffc-2055-4f77-9e14-1e516b72161e service nova] Releasing lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:54 user nova-compute[73091]: WARNING nova.compute.manager [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state building and task_state spawning.
Aug 16 15:11:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:11:54 user nova-compute[73091]: WARNING nova.compute.manager [req-ca500568-2338-4799-a72b-ecc653d132aa req-bedc4671-f8dc-4177-bed5-d6adc3a1b4e7 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state building and task_state spawning.
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198715.028584, 0501f6bc-55a5-4112-9036-1f05880cdd8b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] VM Resumed (Lifecycle Event)
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Instance spawned successfully.
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198715.0372763, 0501f6bc-55a5-4112-9036-1f05880cdd8b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] VM Started (Lifecycle Event)
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 16 15:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:11:55 user nova-compute[73091]: INFO nova.compute.manager [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Took 7.97 seconds to build instance.
Aug 16 15:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c8117ff2-6ea9-4472-bd17-231acbe8f161 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.100s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:11:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG os_brick.utils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27af2843-8597-47a3-a7d5-c076d80ec395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15469c41-c42e-4242-9d74-94d172713284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a02de-a0ac-4203-b8bb-92b2b2c8b522]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6a6943-b862-426f-be79-05b721eb02de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:01 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3458eca5-80e4-43b7-81a2-e6bc51700d26]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG os_brick.utils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:01 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updating existing volume attachment record: 55978f8a-c759-4947-b1c6-800ac940aa03 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:05 user nova-compute[73091]: INFO nova.compute.manager [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Detaching volume 15f8e5c1-0fe8-4a34-8dcf-3fc925037d67
Aug 16 15:12:06 user nova-compute[73091]: INFO nova.virt.block_device [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Attempting to driver detach volume 15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 from mountpoint /dev/vdc
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Attempting to detach device vdc from instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:12:06 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:12:06 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:12:06 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:12:06 user nova-compute[73091]:   <serial>15f8e5c1-0fe8-4a34-8dcf-3fc925037d67</serial>
Aug 16 15:12:06 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:12:06 user nova-compute[73091]: </disk>
Aug 16 15:12:06 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:12:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully detached device vdc from instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 from the persistent domain config.
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:12:06 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:12:06 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:12:06 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:12:06 user nova-compute[73091]:   <serial>15f8e5c1-0fe8-4a34-8dcf-3fc925037d67</serial>
Aug 16 15:12:06 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:12:06 user nova-compute[73091]: </disk>
Aug 16 15:12:06 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198726.668648, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:12:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully detached device vdc from instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 from the live domain config.
Aug 16 15:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTVkZKxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a65e473-e19b-4440-9921-e3c3e5aa6fa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90e8b31-b065-44b0-8b13-c98d816627c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:06 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:12:06 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:06 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 (non-flash)
Aug 16 15:12:06 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c387640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1de289-b632-4ff1-bd65-3f420602ed01]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[454febe5-4e6d-4a00-a044-e64372b8bf05]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[296474d6-4819-422d-9028-4e490ddc81a1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[622f0db6-07c0-46d3-88ea-a5312a4c3f0f]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be561c-a91d-4b9f-8295-39fdc2392d4b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1352ee24-e724-46c3-aa16-9bdfdf61b8b7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260]
Aug 16 15:12:07 user nova-compute[73091]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67, portal: 172.16.0.220,3260] successful.
Aug 16 15:12:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f8e5c1-0fe8-4a34-8dcf-3fc925037d67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c3e70-1532-4a8c-b7d5-7bfbd9555732]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] <== disconnect_volume: return (372ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'flavor' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2c98cd72-3812-4298-a14a-a674138daa41 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.157s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:12:09 user nova-compute[73091]: INFO nova.compute.claims [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Claim successful on node user
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.991s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:12:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: INFO nova.virt.block_device [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Booting with volume 9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 at /dev/vda
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.policy [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40bf98e80707482a9c43719d7a56004a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af3ee8a3c64c50a44aa98bcdd05222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG os_brick.utils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1631328-c9bb-412e-9718-390a81880bad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba7d55-7326-4319-8e0a-5442dbc89abf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711ef63-3014-4acb-9820-0a61e9e4c0fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50900d24-9ccf-440f-befb-4000a352163a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:10 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:12:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85889615-99ac-409f-813c-9f05d19c410a]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG os_brick.utils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:10 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating existing volume attachment record: 2a16919d-7303-4790-8a0e-bef8b1f7d7dd {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Successfully created port: 49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Successfully updated port: 49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-changed-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Refreshing instance network info cache due to event network-changed-49080ee5-1f91-48ce-a4f3-c17e08515a4c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] Acquiring lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] Acquired lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Refreshing network info cache for port 49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:12:12 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:12 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7044MB free_disk=25.26526641845703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:12:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7d8df62-ad41-488e-9612-287fee103229 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9a040d49-3d4e-4496-b546-2daf1bf56978 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 0501f6bc-55a5-4112-9036-1f05880cdd8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00074c81-a1e1-4204-bdec-c6ef10254c49 req-ab1ff896-1b0d-4f89-8832-aeba0af2192e service nova] Releasing lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquired lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:12:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Creating image(s)
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Ensure instance console log exists: /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Start _get_guest_xml network_info=[{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '55978f8a-c759-4947-b1c6-800ac940aa03', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6017245-2e44-4fd0-9760-2b8f2e9f6df2', 'attached_at': '', 'detached_at': '', 'volume_id': '4947e013-c893-4747-8d39-619ae7f31d7d', 'serial': '4947e013-c893-4747-8d39-619ae7f31d7d'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:12:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:13 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53eafab-ef3a-4431-9731-96825111bd61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:12:13 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6e9b34-daa0-42b5-80b9-14f50b776c22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d] added
Aug 16 15:12:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Releasing lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance network_info: |[{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d55531-e9b7-4577-a550-fee9a3c73d58]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.231s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff0019-84ff-486b-b23f-c8c62f256f96]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsQSHbpd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsQSHbpd" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca8b44-acbc-4e14-9ad6-f21740152f2e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsQSHbpd'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1704fb8c-4725-4f8c-91b3-c54380286eee]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2312f2b-9eae-4e59-a34c-818be2e64fbf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:13 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:13 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54be4e7-ccc6-470f-915b-41b0a4673424]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260]
Aug 16 15:12:14 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260] successful.
Aug 16 15:12:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24bb630-316e-40bf-aeff-f626d9df5415]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c6509-f86b-4760-ba2d-65c95ef9e6be]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:14 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:14 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:14 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:14 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581a21b-c2b9-4091-9a35-56a0c4a3f139]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23463373533646538', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463373533646538', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1387492187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1387492187',id=30,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-iz7v0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:11:50Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=c6017245-2e44-4fd0-9760-2b8f2e9f6df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'pci_devices' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:12:15 user nova-compute[73091]:   <uuid>c6017245-2e44-4fd0-9760-2b8f2e9f6df2</uuid>
Aug 16 15:12:15 user nova-compute[73091]:   <name>instance-0000001e</name>
Aug 16 15:12:15 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:12:15 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:12:15 user nova-compute[73091]:   <metadata>
Aug 16 15:12:15 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:12:15 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:12:15 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1387492187</nova:name>
Aug 16 15:12:15 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:12:13</nova:creationTime>
Aug 16 15:12:15 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:12:15 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:12:15 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:12:15 user nova-compute[73091]:       <nova:owner>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:user uuid="c0243ed66e484f6a820421b1f69ece02">tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member</nova:user>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:project uuid="7c4d07f3079144a59f93086e00017115">tempest-ServerBootFromVolumeStableRescueTest-909556237</nova:project>
Aug 16 15:12:15 user nova-compute[73091]:       </nova:owner>
Aug 16 15:12:15 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:12:15 user nova-compute[73091]:       <nova:ports>
Aug 16 15:12:15 user nova-compute[73091]:         <nova:port uuid="e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc">
Aug 16 15:12:15 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:12:15 user nova-compute[73091]:         </nova:port>
Aug 16 15:12:15 user nova-compute[73091]:       </nova:ports>
Aug 16 15:12:15 user nova-compute[73091]:     </nova:instance>
Aug 16 15:12:15 user nova-compute[73091]:   </metadata>
Aug 16 15:12:15 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:12:15 user nova-compute[73091]:     <system>
Aug 16 15:12:15 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:12:15 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:12:15 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:12:15 user nova-compute[73091]:       <entry name="serial">c6017245-2e44-4fd0-9760-2b8f2e9f6df2</entry>
Aug 16 15:12:15 user nova-compute[73091]:       <entry name="uuid">c6017245-2e44-4fd0-9760-2b8f2e9f6df2</entry>
Aug 16 15:12:15 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:12:15 user nova-compute[73091]:     </system>
Aug 16 15:12:15 user nova-compute[73091]:   </sysinfo>
Aug 16 15:12:15 user nova-compute[73091]:   <os>
Aug 16 15:12:15 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:12:15 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:12:15 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:12:15 user nova-compute[73091]:   </os>
Aug 16 15:12:15 user nova-compute[73091]:   <features>
Aug 16 15:12:15 user nova-compute[73091]:     <acpi/>
Aug 16 15:12:15 user nova-compute[73091]:     <apic/>
Aug 16 15:12:15 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:12:15 user nova-compute[73091]:   </features>
Aug 16 15:12:15 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:12:15 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:12:15 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:12:15 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:12:15 user nova-compute[73091]:   </clock>
Aug 16 15:12:15 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:12:15 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:12:15 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:12:15 user nova-compute[73091]:   </cpu>
Aug 16 15:12:15 user nova-compute[73091]:   <devices>
Aug 16 15:12:15 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:12:15 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:12:15 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:12:15 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:12:15 user nova-compute[73091]:       <serial>4947e013-c893-4747-8d39-619ae7f31d7d</serial>
Aug 16 15:12:15 user nova-compute[73091]:     </disk>
Aug 16 15:12:15 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:12:15 user nova-compute[73091]:       <mac address="fa:16:3e:1f:3b:92"/>
Aug 16 15:12:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:12:15 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:12:15 user nova-compute[73091]:       <target dev="tape9c19b22-d6"/>
Aug 16 15:12:15 user nova-compute[73091]:     </interface>
Aug 16 15:12:15 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:12:15 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/console.log" append="off"/>
Aug 16 15:12:15 user nova-compute[73091]:     </serial>
Aug 16 15:12:15 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:12:15 user nova-compute[73091]:     <video>
Aug 16 15:12:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:12:15 user nova-compute[73091]:     </video>
Aug 16 15:12:15 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:12:15 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:12:15 user nova-compute[73091]:     </rng>
Aug 16 15:12:15 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:12:15 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:12:15 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:12:15 user nova-compute[73091]:     </memballoon>
Aug 16 15:12:15 user nova-compute[73091]:   </devices>
Aug 16 15:12:15 user nova-compute[73091]: </domain>
Aug 16 15:12:15 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1387492187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1387492187',id=30,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-iz7v0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:11:50Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=c6017245-2e44-4fd0-9760-2b8f2e9f6df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG os_vif [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9c19b22-d6, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9c19b22-d6, col_values=(('external_ids', {'iface-id': 'e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:3b:92', 'vm-uuid': 'c6017245-2e44-4fd0-9760-2b8f2e9f6df2'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:15 user nova-compute[73091]: INFO os_vif [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6')
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:12:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No VIF found with MAC fa:16:3e:1f:3b:92, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:12:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-f67102f5-1e4e-42d6-922f-78042d89e93d req-023f0937-e64a-4e71-8f38-99deee910a50 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f67102f5-1e4e-42d6-922f-78042d89e93d req-023f0937-e64a-4e71-8f38-99deee910a50 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f67102f5-1e4e-42d6-922f-78042d89e93d req-023f0937-e64a-4e71-8f38-99deee910a50 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f67102f5-1e4e-42d6-922f-78042d89e93d req-023f0937-e64a-4e71-8f38-99deee910a50 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-f67102f5-1e4e-42d6-922f-78042d89e93d req-023f0937-e64a-4e71-8f38-99deee910a50 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:17 user nova-compute[73091]: WARNING nova.compute.manager [req-f67102f5-1e4e-42d6-922f-78042d89e93d req-023f0937-e64a-4e71-8f38-99deee910a50 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state building and task_state spawning.
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198739.0259528, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Resumed (Lifecycle Event)
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance spawned successfully.
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198739.0278459, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Started (Lifecycle Event)
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-928677f9-c320-44b6-a5dd-596a976fe8c3 req-8764b895-9950-480b-bea8-05a6e4c3247e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-928677f9-c320-44b6-a5dd-596a976fe8c3 req-8764b895-9950-480b-bea8-05a6e4c3247e service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-928677f9-c320-44b6-a5dd-596a976fe8c3 req-8764b895-9950-480b-bea8-05a6e4c3247e service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-928677f9-c320-44b6-a5dd-596a976fe8c3 req-8764b895-9950-480b-bea8-05a6e4c3247e service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-928677f9-c320-44b6-a5dd-596a976fe8c3 req-8764b895-9950-480b-bea8-05a6e4c3247e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:19 user nova-compute[73091]: WARNING nova.compute.manager [req-928677f9-c320-44b6-a5dd-596a976fe8c3 req-8764b895-9950-480b-bea8-05a6e4c3247e service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state building and task_state spawning.
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 16 15:12:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:19 user nova-compute[73091]: INFO nova.compute.manager [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Took 30.37 seconds to build instance.
Aug 16 15:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7783659d-df37-4dec-a283-e8a31b4571b2 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.577s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:12:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:12:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:12:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Creating image(s)
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6d2c04-e78d-439f-8259-e3fae71840ba/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Start _get_guest_xml network_info=[{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '2a16919d-7303-4790-8a0e-bef8b1f7d7dd', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e6d2c04-e78d-439f-8259-e3fae71840ba', 'attached_at': '', 'detached_at': '', 'volume_id': '9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6', 'serial': '9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:12:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:23 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b23ecb3-24b9-4691-9efd-febe8a215da3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:12:23 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422e59e-f716-49da-a5cd-7718471df42e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6] added
Aug 16 15:12:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafab4e8-2526-4e1d-9412-238a6d33e1b0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c18fb-388d-42c7-bdc2-6d8e91123ac7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIGfFpKv {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIGfFpKv" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ec4a8-73fb-40b6-a703-15141b93a46d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIGfFpKv'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8d424-da58-4827-b63c-0e2e4521d8bf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[915678e3-d827-4709-88fd-3a37fdc2f7f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d2bbe-947e-45a5-b72a-330aa02d9ce8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]
Aug 16 15:12:23 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.
Aug 16 15:12:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340d1e4-0fb5-4ab7-98f9-6f64cd97741e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa4e6e2-2271-4f95-86c3-69268e68a463]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:23 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f1f87f-55b2-4e3f-ac52-636983857a3e]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23163663766326566', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163663766326566', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-239578980',display_name='tempest-ServerActionsTestOtherA-server-239578980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-239578980',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-xpmo7ft2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8e6d2c04-e78d-439f-8259-e3fae71840ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:12:24 user nova-compute[73091]:   <uuid>8e6d2c04-e78d-439f-8259-e3fae71840ba</uuid>
Aug 16 15:12:24 user nova-compute[73091]:   <name>instance-0000001f</name>
Aug 16 15:12:24 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:12:24 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:12:24 user nova-compute[73091]:   <metadata>
Aug 16 15:12:24 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:12:24 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:12:24 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-239578980</nova:name>
Aug 16 15:12:24 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:12:23</nova:creationTime>
Aug 16 15:12:24 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:12:24 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:12:24 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:12:24 user nova-compute[73091]:       <nova:owner>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:user uuid="40bf98e80707482a9c43719d7a56004a">tempest-ServerActionsTestOtherA-305054434-project-member</nova:user>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:project uuid="99af3ee8a3c64c50a44aa98bcdd05222">tempest-ServerActionsTestOtherA-305054434</nova:project>
Aug 16 15:12:24 user nova-compute[73091]:       </nova:owner>
Aug 16 15:12:24 user nova-compute[73091]:       <nova:ports>
Aug 16 15:12:24 user nova-compute[73091]:         <nova:port uuid="49080ee5-1f91-48ce-a4f3-c17e08515a4c">
Aug 16 15:12:24 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:12:24 user nova-compute[73091]:         </nova:port>
Aug 16 15:12:24 user nova-compute[73091]:       </nova:ports>
Aug 16 15:12:24 user nova-compute[73091]:     </nova:instance>
Aug 16 15:12:24 user nova-compute[73091]:   </metadata>
Aug 16 15:12:24 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:12:24 user nova-compute[73091]:     <system>
Aug 16 15:12:24 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:12:24 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:12:24 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:12:24 user nova-compute[73091]:       <entry name="serial">8e6d2c04-e78d-439f-8259-e3fae71840ba</entry>
Aug 16 15:12:24 user nova-compute[73091]:       <entry name="uuid">8e6d2c04-e78d-439f-8259-e3fae71840ba</entry>
Aug 16 15:12:24 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:12:24 user nova-compute[73091]:     </system>
Aug 16 15:12:24 user nova-compute[73091]:   </sysinfo>
Aug 16 15:12:24 user nova-compute[73091]:   <os>
Aug 16 15:12:24 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:12:24 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:12:24 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:12:24 user nova-compute[73091]:   </os>
Aug 16 15:12:24 user nova-compute[73091]:   <features>
Aug 16 15:12:24 user nova-compute[73091]:     <acpi/>
Aug 16 15:12:24 user nova-compute[73091]:     <apic/>
Aug 16 15:12:24 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:12:24 user nova-compute[73091]:   </features>
Aug 16 15:12:24 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:12:24 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:12:24 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:12:24 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:12:24 user nova-compute[73091]:   </clock>
Aug 16 15:12:24 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:12:24 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:12:24 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:12:24 user nova-compute[73091]:   </cpu>
Aug 16 15:12:24 user nova-compute[73091]:   <devices>
Aug 16 15:12:24 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:12:24 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:12:24 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 15:12:24 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:12:24 user nova-compute[73091]:       <serial>9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6</serial>
Aug 16 15:12:24 user nova-compute[73091]:     </disk>
Aug 16 15:12:24 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:12:24 user nova-compute[73091]:       <mac address="fa:16:3e:b0:68:25"/>
Aug 16 15:12:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:12:24 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:12:24 user nova-compute[73091]:       <target dev="tap49080ee5-1f"/>
Aug 16 15:12:24 user nova-compute[73091]:     </interface>
Aug 16 15:12:24 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:12:24 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8e6d2c04-e78d-439f-8259-e3fae71840ba/console.log" append="off"/>
Aug 16 15:12:24 user nova-compute[73091]:     </serial>
Aug 16 15:12:24 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:12:24 user nova-compute[73091]:     <video>
Aug 16 15:12:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:12:24 user nova-compute[73091]:     </video>
Aug 16 15:12:24 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:12:24 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:12:24 user nova-compute[73091]:     </rng>
Aug 16 15:12:24 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:12:24 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:12:24 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:12:24 user nova-compute[73091]:     </memballoon>
Aug 16 15:12:24 user nova-compute[73091]:   </devices>
Aug 16 15:12:24 user nova-compute[73091]: </domain>
Aug 16 15:12:24 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-239578980',display_name='tempest-ServerActionsTestOtherA-server-239578980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-239578980',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-xpmo7ft2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8e6d2c04-e78d-439f-8259-e3fae71840ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG os_vif [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49080ee5-1f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49080ee5-1f, col_values=(('external_ids', {'iface-id': '49080ee5-1f91-48ce-a4f3-c17e08515a4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:68:25', 'vm-uuid': '8e6d2c04-e78d-439f-8259-e3fae71840ba'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:24 user nova-compute[73091]: INFO os_vif [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f')
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:12:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No VIF found with MAC fa:16:3e:b0:68:25, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-b107bb73-8feb-4e0b-9f66-8c974a9700ed req-1e1909ed-f8e4-49e3-ab6f-502f1622ebae service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b107bb73-8feb-4e0b-9f66-8c974a9700ed req-1e1909ed-f8e4-49e3-ab6f-502f1622ebae service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b107bb73-8feb-4e0b-9f66-8c974a9700ed req-1e1909ed-f8e4-49e3-ab6f-502f1622ebae service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b107bb73-8feb-4e0b-9f66-8c974a9700ed req-1e1909ed-f8e4-49e3-ab6f-502f1622ebae service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-b107bb73-8feb-4e0b-9f66-8c974a9700ed req-1e1909ed-f8e4-49e3-ab6f-502f1622ebae service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:26 user nova-compute[73091]: WARNING nova.compute.manager [req-b107bb73-8feb-4e0b-9f66-8c974a9700ed req-1e1909ed-f8e4-49e3-ab6f-502f1622ebae service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state building and task_state spawning.
Aug 16 15:12:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198748.2794526, 8e6d2c04-e78d-439f-8259-e3fae71840ba => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] VM Resumed (Lifecycle Event)
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance spawned successfully.
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198748.2807987, 8e6d2c04-e78d-439f-8259-e3fae71840ba => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] VM Started (Lifecycle Event)
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d8ebb1d-0597-4469-94e1-4fcd65325912 req-a9dbbb01-b0d8-4155-b745-48c17e46c003 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d8ebb1d-0597-4469-94e1-4fcd65325912 req-a9dbbb01-b0d8-4155-b745-48c17e46c003 service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d8ebb1d-0597-4469-94e1-4fcd65325912 req-a9dbbb01-b0d8-4155-b745-48c17e46c003 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d8ebb1d-0597-4469-94e1-4fcd65325912 req-a9dbbb01-b0d8-4155-b745-48c17e46c003 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d8ebb1d-0597-4469-94e1-4fcd65325912 req-a9dbbb01-b0d8-4155-b745-48c17e46c003 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:28 user nova-compute[73091]: WARNING nova.compute.manager [req-7d8ebb1d-0597-4469-94e1-4fcd65325912 req-a9dbbb01-b0d8-4155-b745-48c17e46c003 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state building and task_state spawning.
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 16 15:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:12:28 user nova-compute[73091]: INFO nova.compute.manager [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Took 19.07 seconds to build instance.
Aug 16 15:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd1af606-c21e-47bd-b6f2-03fa84896ef7 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.382s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'flavor' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:32 user nova-compute[73091]: INFO nova.compute.manager [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Attaching volume 5b38c794-c8e4-4755-b10d-b8269908ee50 to /dev/vdb
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc14b5b-278a-49c3-a0d9-87f83a3e5785]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0c7472-4555-4e07-bad7-ab2e71dd6fa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f7a2d5-8649-481d-bb32-4f8c8b25578c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c34a15-2018-4269-867f-e44ca021d8d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:32 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19efaf57-b05f-48a0-82b9-9e1d46347918]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating existing volume attachment record: 56d114b9-3174-4545-b02e-6bd332b1dbad {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'flavor' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:32 user nova-compute[73091]: INFO nova.compute.manager [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Attaching volume bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 to /dev/vdb
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ab8e4-69c0-4cdc-a117-bfddfb4f4066]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a44a9d-d65d-4568-98f8-62cc8b551323]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e62ca-516a-487c-9d85-b70379ef1b54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c45078-2d2f-4bc4-8609-d8db484f3207]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:32 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:12:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b4571-045a-44da-8754-957f361e2f95]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:32 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating existing volume attachment record: 8c63f7de-4084-49f9-88eb-3c8b860281ef {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:44 user nova-compute[73091]: INFO nova.compute.manager [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] instance snapshotting
Aug 16 15:12:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Beginning live snapshot process
Aug 16 15:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptio5b76e/d2c2489a47d6461db01883acb5c5bf00.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptio5b76e/d2c2489a47d6461db01883acb5c5bf00.delta 1073741824" returned: 0 in 0.068s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 15:12:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:45 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:45 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:45 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d85866-54b0-4aa4-9aab-28ee38a9148b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:12:45 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab264ca-3707-4eba-9660-990032610fb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67] added
Aug 16 15:12:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595009c-46ba-4777-a461-5b091df06f63]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[408731d2-8422-49c3-849e-7bb841b8ee98]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrhAYaNQ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrhAYaNQ" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9f075f-62b4-4d9e-a07c-7a1a1238ee6c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrhAYaNQ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36dd1d-9e6a-40c9-bbe7-d305c33278e0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4561b0-78b2-427b-9c4f-0f1b1cc6431e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad681c-0667-4f57-a1f5-62cc1d1ceb9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]
Aug 16 15:12:45 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:12:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f8c825-ded6-440a-81c8-537ae1f0091f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3882fd-9c96-4eae-a642-130ce6086373]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:12:45 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b46de-ef75-4dbb-bf81-87b5a6f3af7d]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:12:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:12:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 15:12:46 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptio5b76e/d2c2489a47d6461db01883acb5c5bf00.delta /opt/stack/data/nova/instances/snapshots/tmptio5b76e/d2c2489a47d6461db01883acb5c5bf00 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26639626531333064', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639626531333064', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'flavor' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:12:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:12:46 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:12:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:12:46 user nova-compute[73091]:   <serial>bf6502f7-b3a5-4ada-9afe-2c2762bf3e67</serial>
Aug 16 15:12:46 user nova-compute[73091]: </disk>
Aug 16 15:12:46 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptio5b76e/d2c2489a47d6461db01883acb5c5bf00.delta /opt/stack/data/nova/instances/snapshots/tmptio5b76e/d2c2489a47d6461db01883acb5c5bf00" returned: 0 in 0.749s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Snapshot extracted, beginning image upload
Aug 16 15:12:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:12:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:12:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No VIF found with MAC fa:16:3e:05:9f:63, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c513cc1-171e-4485-b787-ee1fed30ae4e tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.755s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Stashing vm_state: active {{(pid=73091) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'pci_requests' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:12:49 user nova-compute[73091]: INFO nova.compute.claims [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Claim successful on node user
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'resources' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'pci_devices' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:49 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating resource usage from migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f
Aug 16 15:12:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Snapshot image upload complete
Aug 16 15:12:49 user nova-compute[73091]: INFO nova.compute.manager [None req-7bad1cdf-9758-4635-bce7-34f16d74a527 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Took 5.41 seconds to snapshot the instance on the hypervisor.
Aug 16 15:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.603s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:49 user nova-compute[73091]: INFO nova.compute.manager [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Migrating
Aug 16 15:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:49 user nova-compute[73091]: INFO nova.compute.rpcapi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 15:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Starting migrate_disk_and_power_off {{(pid=73091) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-61d136be-d74f-4388-843a-f1f1ab4c2c48 req-54549948-5a85-478c-a8c5-56bd77d511ed service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-61d136be-d74f-4388-843a-f1f1ab4c2c48 req-54549948-5a85-478c-a8c5-56bd77d511ed service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-61d136be-d74f-4388-843a-f1f1ab4c2c48 req-54549948-5a85-478c-a8c5-56bd77d511ed service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-61d136be-d74f-4388-843a-f1f1ab4c2c48 req-54549948-5a85-478c-a8c5-56bd77d511ed service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-61d136be-d74f-4388-843a-f1f1ab4c2c48 req-54549948-5a85-478c-a8c5-56bd77d511ed service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:51 user nova-compute[73091]: WARNING nova.compute.manager [req-61d136be-d74f-4388-843a-f1f1ab4c2c48 req-54549948-5a85-478c-a8c5-56bd77d511ed service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state active and task_state resize_migrating.
Aug 16 15:12:51 user nova-compute[73091]: INFO nova.compute.manager [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Unrescuing
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance destroyed successfully.
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf94a19b5-a2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:51 user nova-compute[73091]: INFO os_vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2')
Aug 16 15:12:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:51 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce519d1-38d4-43d2-91f7-1a3f3a0c3f71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[451130e8-6133-4793-8044-0d480eccada8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:12:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:51 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:12:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c57a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af3331-a51d-4f60-9911-08ec04599f0e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ecb803-7762-4849-8ff3-301bbb8f07a0]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8706496-8372-4bd7-9e1a-2631568ea429]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[623cb8a3-182e-427b-bc8d-eb98992caae6]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f3d037-22c5-4da6-83f0-e3529d3c1c14]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b732bb6-41d0-4b64-85c1-e3b41ab417e9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]
Aug 16 15:12:52 user nova-compute[73091]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:12:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[569eecd9-fbb2-4773-96fa-a66f465b5ba0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== disconnect_volume: return (330ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752_resize/disk /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'flavor' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "cp -r /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752_resize/disk /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk" returned: 0 in 0.538s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752_resize/disk.info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk.info {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "cp -r /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752_resize/disk.info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk.info" returned: 0 in 0.042s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:12:53 user nova-compute[73091]: INFO nova.compute.claims [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Claim successful on node user
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:53 user nova-compute[73091]: WARNING nova.compute.manager [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state active and task_state resize_migrating.
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:53 user nova-compute[73091]: WARNING nova.compute.manager [req-bbbe2650-f56b-47bb-a5d5-6a73efa79698 req-5434a8da-5408-4d7b-81f9-86ae6d67fc8a service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:12:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance destroyed successfully.
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:12:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.policy [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f00f519b688c4e2fbddbb792c9d02538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0baba8e83d4fde9afda048ecd7b317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:12:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Creating image(s)
Aug 16 15:12:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "/opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "/opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "84a9b24521a60880473d92ec8ef9625fbe08ece9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "84a9b24521a60880473d92ec8ef9625fbe08ece9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Port f94a19b5-a285-4efb-9931-8f26831a7382 binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Successfully created port: 3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-b731fcd6-5ee5-4b81-8470-c05591ea36bc req-ef9688b0-6fd1-4eec-8815-3661bc218616 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b731fcd6-5ee5-4b81-8470-c05591ea36bc req-ef9688b0-6fd1-4eec-8815-3661bc218616 service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b731fcd6-5ee5-4b81-8470-c05591ea36bc req-ef9688b0-6fd1-4eec-8815-3661bc218616 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b731fcd6-5ee5-4b81-8470-c05591ea36bc req-ef9688b0-6fd1-4eec-8815-3661bc218616 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-b731fcd6-5ee5-4b81-8470-c05591ea36bc req-ef9688b0-6fd1-4eec-8815-3661bc218616 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:56 user nova-compute[73091]: WARNING nova.compute.manager [req-b731fcd6-5ee5-4b81-8470-c05591ea36bc req-ef9688b0-6fd1-4eec-8815-3661bc218616 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.part --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.virt.images [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] d0b98536-c5c3-4e83-9b47-0904c59e2965 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.part /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:56 user nova-compute[73091]: INFO nova.compute.manager [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Terminating instance
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.part /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.converted" returned: 0 in 0.553s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:12:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "84a9b24521a60880473d92ec8ef9625fbe08ece9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.393s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9da2ad-59db-488f-a1dc-d0bddab29acf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957d04a-330b-4638-b953-1d9b63395496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3780c57-9cf8-4c8b-ac71-0bcde4e22cfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac0907-96fb-4f17-8395-e8633d8bc2bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:12:57 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6850e31-7d2f-4104-b973-0b6fe020d608]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 --force-share --output=json" returned: 0 in 0.255s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "84a9b24521a60880473d92ec8ef9625fbe08ece9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "84a9b24521a60880473d92ec8ef9625fbe08ece9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Instance destroyed successfully.
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'resources' on Instance uuid 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Successfully updated port: 3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1432407467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1432407467',id=20,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTdrq52bxwbvCCopZobtCA9IYWKP27UTtYnxFo42/vyruNRnyGf54dmJu8XN2YyXoyW3Zbb6a+qSPV31CAPz2dj0p04rQwXfuvkr5u9sNDyI9Z9wnB11+4LRJp34x5AOg==',key_name='tempest-keypair-1998158073',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-1lqullfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=8263a95b-fe6a-45c8-a94e-dccd6ec5f623,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "address": "fa:16:3e:7f:7e:73", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63bacab4-37", "ovs_interfaceid": "63bacab4-3783-4ad9-8076-c90b88f0d3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_vif [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63bacab4-37, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquired lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:12:57 user nova-compute[73091]: INFO os_vif [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7e:73,bridge_name='br-int',has_traffic_filtering=True,id=63bacab4-3783-4ad9-8076-c90b88f0d3fc,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63bacab4-37')
Aug 16 15:12:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Deleting instance files /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623_del
Aug 16 15:12:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Deletion of /opt/stack/data/nova/instances/8263a95b-fe6a-45c8-a94e-dccd6ec5f623_del complete
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-changed-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Refreshing instance network info cache due to event network-changed-3f1e4bec-a4fc-4b6b-a849-57156d17ceed. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] Acquiring lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:57 user nova-compute[73091]: WARNING nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:57 user nova-compute[73091]: WARNING nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-unplugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-unplugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-unplugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Acquiring lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] No waiting events found dispatching network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:12:57 user nova-compute[73091]: WARNING nova.compute.manager [req-cc2ee242-3c12-4edc-972d-7c3b392f2cf6 req-1a1bc91b-de6f-4ef3-811e-8a5fe683bb9c service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received unexpected event network-vif-plugged-63bacab4-3783-4ad9-8076-c90b88f0d3fc for instance with vm_state active and task_state deleting.
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9,backing_fmt=raw /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9,backing_fmt=raw /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "84a9b24521a60880473d92ec8ef9625fbe08ece9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:57 user nova-compute[73091]: INFO nova.compute.manager [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'migration_context' on Instance uuid 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Ensure instance console log exists: /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updating instance_info_cache with network_info: [{"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Releasing lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Instance network_info: |[{"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] Acquired lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Refreshing network info cache for port 3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Start _get_guest_xml network_info=[{"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='464d9fb06d9ec7abf48c7cac0b1c5daa',container_format='bare',created_at=2023-08-16T15:12:44Z,direct_url=<?>,disk_format='qcow2',id=d0b98536-c5c3-4e83-9b47-0904c59e2965,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-233756077',owner='eb0baba8e83d4fde9afda048ecd7b317',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T15:12:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'd0b98536-c5c3-4e83-9b47-0904c59e2965'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:12:57 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:57 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='464d9fb06d9ec7abf48c7cac0b1c5daa',container_format='bare',created_at=2023-08-16T15:12:44Z,direct_url=<?>,disk_format='qcow2',id=d0b98536-c5c3-4e83-9b47-0904c59e2965,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-233756077',owner='eb0baba8e83d4fde9afda048ecd7b317',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T15:12:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-528572090',display_name='tempest-TestStampPattern-server-528572090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-528572090',id=32,image_ref='d0b98536-c5c3-4e83-9b47-0904c59e2965',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyyAHLuiEqk4ejPwZhUcUKJyBqGOrb26zCZeDgHOg2VmzOCttHuqlkmEdCyFVOyQf9aIP2jNoS5d8k16YNuBnyk8HTbk6rg3OFMv70c4z0S2JbDt5MlYiurLWhEiKpxw==',key_name='tempest-TestStampPattern-728212450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0baba8e83d4fde9afda048ecd7b317',ramdisk_id='',reservation_id='r-p0tgvshw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fd4b79ad-6f00-41f3-addc-ada5aa1f84f6',image_min_disk='1',image_min_ram='0',image_owner_id='eb0baba8e83d4fde9afda048ecd7b317',image_owner_project_name='tempest-TestStampPattern-1880881768',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1880881768-project-member',image_user_id='f00f519b688c4e2fbddbb792c9d02538',network_allocated='True',owner_project_name='tempest-TestStampPattern-1880881768',owner_user_name='tempest-TestStampPattern-1880881768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:54Z,user_data=None,user_id='f00f519b688c4e2fbddbb792c9d02538',uuid=7b091903-0cb2-4e1e-9df9-a7570facb46e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converting VIF {"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:12:57 user nova-compute[73091]:   <uuid>7b091903-0cb2-4e1e-9df9-a7570facb46e</uuid>
Aug 16 15:12:57 user nova-compute[73091]:   <name>instance-00000020</name>
Aug 16 15:12:57 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:12:57 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:12:57 user nova-compute[73091]:   <metadata>
Aug 16 15:12:57 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:12:57 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:12:57 user nova-compute[73091]:       <nova:name>tempest-TestStampPattern-server-528572090</nova:name>
Aug 16 15:12:57 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:12:57</nova:creationTime>
Aug 16 15:12:57 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:12:57 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:12:57 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:12:57 user nova-compute[73091]:       <nova:owner>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:user uuid="f00f519b688c4e2fbddbb792c9d02538">tempest-TestStampPattern-1880881768-project-member</nova:user>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:project uuid="eb0baba8e83d4fde9afda048ecd7b317">tempest-TestStampPattern-1880881768</nova:project>
Aug 16 15:12:57 user nova-compute[73091]:       </nova:owner>
Aug 16 15:12:57 user nova-compute[73091]:       <nova:root type="image" uuid="d0b98536-c5c3-4e83-9b47-0904c59e2965"/>
Aug 16 15:12:57 user nova-compute[73091]:       <nova:ports>
Aug 16 15:12:57 user nova-compute[73091]:         <nova:port uuid="3f1e4bec-a4fc-4b6b-a849-57156d17ceed">
Aug 16 15:12:57 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:12:57 user nova-compute[73091]:         </nova:port>
Aug 16 15:12:57 user nova-compute[73091]:       </nova:ports>
Aug 16 15:12:57 user nova-compute[73091]:     </nova:instance>
Aug 16 15:12:57 user nova-compute[73091]:   </metadata>
Aug 16 15:12:57 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:12:57 user nova-compute[73091]:     <system>
Aug 16 15:12:57 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:12:57 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:12:57 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:12:57 user nova-compute[73091]:       <entry name="serial">7b091903-0cb2-4e1e-9df9-a7570facb46e</entry>
Aug 16 15:12:57 user nova-compute[73091]:       <entry name="uuid">7b091903-0cb2-4e1e-9df9-a7570facb46e</entry>
Aug 16 15:12:57 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:12:57 user nova-compute[73091]:     </system>
Aug 16 15:12:57 user nova-compute[73091]:   </sysinfo>
Aug 16 15:12:57 user nova-compute[73091]:   <os>
Aug 16 15:12:57 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:12:57 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:12:57 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:12:57 user nova-compute[73091]:   </os>
Aug 16 15:12:57 user nova-compute[73091]:   <features>
Aug 16 15:12:57 user nova-compute[73091]:     <acpi/>
Aug 16 15:12:57 user nova-compute[73091]:     <apic/>
Aug 16 15:12:57 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:12:57 user nova-compute[73091]:   </features>
Aug 16 15:12:57 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:12:57 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:12:57 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:12:57 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:12:57 user nova-compute[73091]:   </clock>
Aug 16 15:12:57 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:12:57 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:12:57 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:12:57 user nova-compute[73091]:   </cpu>
Aug 16 15:12:57 user nova-compute[73091]:   <devices>
Aug 16 15:12:57 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:12:57 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:12:57 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk"/>
Aug 16 15:12:57 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:12:57 user nova-compute[73091]:     </disk>
Aug 16 15:12:57 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:12:57 user nova-compute[73091]:       <mac address="fa:16:3e:65:d8:7b"/>
Aug 16 15:12:57 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:12:57 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:12:57 user nova-compute[73091]:       <target dev="tap3f1e4bec-a4"/>
Aug 16 15:12:57 user nova-compute[73091]:     </interface>
Aug 16 15:12:57 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:12:57 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/console.log" append="off"/>
Aug 16 15:12:57 user nova-compute[73091]:     </serial>
Aug 16 15:12:57 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:12:57 user nova-compute[73091]:     <video>
Aug 16 15:12:57 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:12:57 user nova-compute[73091]:     </video>
Aug 16 15:12:57 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:12:57 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:12:57 user nova-compute[73091]:     </rng>
Aug 16 15:12:57 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:12:57 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:12:57 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:12:57 user nova-compute[73091]:     </memballoon>
Aug 16 15:12:57 user nova-compute[73091]:   </devices>
Aug 16 15:12:57 user nova-compute[73091]: </domain>
Aug 16 15:12:57 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-528572090',display_name='tempest-TestStampPattern-server-528572090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-528572090',id=32,image_ref='d0b98536-c5c3-4e83-9b47-0904c59e2965',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyyAHLuiEqk4ejPwZhUcUKJyBqGOrb26zCZeDgHOg2VmzOCttHuqlkmEdCyFVOyQf9aIP2jNoS5d8k16YNuBnyk8HTbk6rg3OFMv70c4z0S2JbDt5MlYiurLWhEiKpxw==',key_name='tempest-TestStampPattern-728212450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0baba8e83d4fde9afda048ecd7b317',ramdisk_id='',reservation_id='r-p0tgvshw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fd4b79ad-6f00-41f3-addc-ada5aa1f84f6',image_min_disk='1',image_min_ram='0',image_owner_id='eb0baba8e83d4fde9afda048ecd7b317',image_owner_project_name='tempest-TestStampPattern-1880881768',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1880881768-project-member',image_user_id='f00f519b688c4e2fbddbb792c9d02538',network_allocated='True',owner_project_name='tempest-TestStampPattern-1880881768',owner_user_name='tempest-TestStampPattern-1880881768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:54Z,user_data=None,user_id='f00f519b688c4e2fbddbb792c9d02538',uuid=7b091903-0cb2-4e1e-9df9-a7570facb46e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converting VIF {"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG os_vif [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f1e4bec-a4, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f1e4bec-a4, col_values=(('external_ids', {'iface-id': '3f1e4bec-a4fc-4b6b-a849-57156d17ceed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:d8:7b', 'vm-uuid': '7b091903-0cb2-4e1e-9df9-a7570facb46e'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:12:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:58 user nova-compute[73091]: INFO os_vif [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4')
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No VIF found with MAC fa:16:3e:65:d8:7b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbaae10d-d4d3-4076-8eb4-e4b7e9f1b902 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for 86f25d04-d425-4fcb-b502-f9d0ddee8b6f due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198778.225444, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:12:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Resumed (Lifecycle Event)
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:12:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198778.2267704, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:12:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Started (Lifecycle Event)
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:12:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updated VIF entry in instance network info cache for port 3f1e4bec-a4fc-4b6b-a849-57156d17ceed. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updating instance_info_cache with network_info: [{"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3bd6c0eb-2058-4673-92e1-737dcad83d2e req-9a751349-36da-4bc5-a4af-93258ef4eda0 service nova] Releasing lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:12:58 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Took 0.96 seconds to deallocate network for instance.
Aug 16 15:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b7f663d-0506-46a0-b533-6e8144bb2dc0 req-907bd07e-52c8-419a-b5b0-6353949c5060 service nova] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Received event network-vif-deleted-63bacab4-3783-4ad9-8076-c90b88f0d3fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.600s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:59 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Deleted allocations for instance 8263a95b-fe6a-45c8-a94e-dccd6ec5f623
Aug 16 15:12:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:12:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:12:59 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94223f7d-b337-4e9d-9f2d-3c30a894db47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:12:59 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[98be4e6d-1b41-46c9-9d4c-53f2b8b5300a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50] added
Aug 16 15:12:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-299b1b3c-ad89-4548-a0ba-b01490e8f931 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "8263a95b-fe6a-45c8-a94e-dccd6ec5f623" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4088eb-99f5-497a-b534-1c39de6e0ca9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f78d5d-5509-491a-ad15-704181da46d3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioXvbwtl {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioXvbwtl" returned: 0 in 0.284s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e217ed-8b71-4709-95ad-37463ac32e39]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ioXvbwtl'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc4772-51a8-4010-8569-5d7b841645d9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b16f52-d676-49d3-bcfc-a8001a4b3dc6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9478ed-44ce-4373-b99d-a245fadfc595]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]
Aug 16 15:12:59 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.
Aug 16 15:12:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d58477-581d-4b9e-8be4-141350d10741]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27961220-f941-4ce9-9083-6e4b86bc0c53]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:12:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.645s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.039s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a0ad4-4ddd-4187-82a8-d8057873d8f8]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-2450ce18-17ae-4ebf-b000-8c31a37a2350 req-0edea45e-5369-433a-a542-d4e22302157d service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2450ce18-17ae-4ebf-b000-8c31a37a2350 req-0edea45e-5369-433a-a542-d4e22302157d service nova] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2450ce18-17ae-4ebf-b000-8c31a37a2350 req-0edea45e-5369-433a-a542-d4e22302157d service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2450ce18-17ae-4ebf-b000-8c31a37a2350 req-0edea45e-5369-433a-a542-d4e22302157d service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-2450ce18-17ae-4ebf-b000-8c31a37a2350 req-0edea45e-5369-433a-a542-d4e22302157d service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] No waiting events found dispatching network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:00 user nova-compute[73091]: WARNING nova.compute.manager [req-2450ce18-17ae-4ebf-b000-8c31a37a2350 req-0edea45e-5369-433a-a542-d4e22302157d service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received unexpected event network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed for instance with vm_state building and task_state spawning.
Aug 16 15:13:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.708s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== connect_volume: return (1710ms) {'type': 'block', 'scsi_wwn': '26333363265393338', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363265393338', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'flavor' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:13:01 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:13:01 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:13:01 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:13:01 user nova-compute[73091]:   <serial>5b38c794-c8e4-4755-b10d-b8269908ee50</serial>
Aug 16 15:13:01 user nova-compute[73091]: </disk>
Aug 16 15:13:01 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No VIF found with MAC fa:16:3e:b0:f8:d9, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:13:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa92a200-6819-4424-a99c-f9530278f0b1 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.449s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-98980a5b-b3b6-4fac-a48a-412d16fe95a0 req-b5653bae-603a-4f18-ad22-a2dc318fb253 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98980a5b-b3b6-4fac-a48a-412d16fe95a0 req-b5653bae-603a-4f18-ad22-a2dc318fb253 service nova] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98980a5b-b3b6-4fac-a48a-412d16fe95a0 req-b5653bae-603a-4f18-ad22-a2dc318fb253 service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98980a5b-b3b6-4fac-a48a-412d16fe95a0 req-b5653bae-603a-4f18-ad22-a2dc318fb253 service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-98980a5b-b3b6-4fac-a48a-412d16fe95a0 req-b5653bae-603a-4f18-ad22-a2dc318fb253 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] No waiting events found dispatching network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:02 user nova-compute[73091]: WARNING nova.compute.manager [req-98980a5b-b3b6-4fac-a48a-412d16fe95a0 req-b5653bae-603a-4f18-ad22-a2dc318fb253 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received unexpected event network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed for instance with vm_state building and task_state spawning.
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198782.391503, 7b091903-0cb2-4e1e-9df9-a7570facb46e => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] VM Resumed (Lifecycle Event)
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Instance spawned successfully.
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198782.392858, 7b091903-0cb2-4e1e-9df9-a7570facb46e => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] VM Started (Lifecycle Event)
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Took 7.88 seconds to spawn the instance on the hypervisor.
Aug 16 15:13:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:13:02 user nova-compute[73091]: INFO nova.compute.manager [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Took 9.48 seconds to build instance.
Aug 16 15:13:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af48a77-7f52-472b-8753-33a4124b7710 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.586s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198771.753739, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:06 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Stopped (Lifecycle Event)
Aug 16 15:13:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-030d124a-681e-4e67-8840-1759d4355ec6 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-030d124a-681e-4e67-8840-1759d4355ec6 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:06 user nova-compute[73091]: INFO nova.compute.manager [None req-030d124a-681e-4e67-8840-1759d4355ec6 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Starting finish_migration {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:13:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Creating image(s)
Aug 16 15:13:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'trusted_certs' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk. size=21474836480 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk 21474836480 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk 21474836480" returned: 0 in 0.045s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Ensure instance console log exists: /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start _get_guest_xml network_info=[{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5573d71f-065e-4555-ac64-4213b0e05ad5', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a42f48f4-9a4e-4b6f-b61c-59b8ba7de752', 'attached_at': '2023-08-16T15:13:09.000000', 'detached_at': '', 'volume_id': 'bf6502f7-b3a5-4ada-9afe-2c2762bf3e67', 'serial': 'bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:13:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'vcpu_model' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:10 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fda92b-8b45-4d7d-a241-52661fcc9818]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:13:10 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d22c52-bdd2-43eb-9930-014ab6627508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67] added
Aug 16 15:13:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd72cfd8-3791-41b2-8a04-15e0d08da33a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[95324395-5458-4559-ab63-d20bfa72903e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrhAYaNQ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrhAYaNQ" returned: 0 in 0.035s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f185f4-10e1-48d3-b6cc-40d6cc73b694]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrhAYaNQ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ab4577-45f1-4a5f-b626-43efd2f97acc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951aab3-d232-4b05-bb89-6218bb8c5f3a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9daedb-a83e-4296-8dd5-16c34a745507]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]
Aug 16 15:13:10 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:13:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f1c2d-7537-470a-aae2-f76432234ef8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecf3282-646f-4c7b-ae45-0a7cf1a5a0fe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[362905ce-3b32-4dea-b7dd-aed98d8c0f51]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '26639626531333064', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639626531333064', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:13:11 user nova-compute[73091]:   <uuid>a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</uuid>
Aug 16 15:13:11 user nova-compute[73091]:   <name>instance-00000017</name>
Aug 16 15:13:11 user nova-compute[73091]:   <memory>2097152</memory>
Aug 16 15:13:11 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:13:11 user nova-compute[73091]:   <metadata>
Aug 16 15:13:11 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:13:11 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:13:11 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-511399511</nova:name>
Aug 16 15:13:11 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:13:10</nova:creationTime>
Aug 16 15:13:11 user nova-compute[73091]:       <nova:flavor name="m1.small">
Aug 16 15:13:11 user nova-compute[73091]:         <nova:memory>2048</nova:memory>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:disk>20</nova:disk>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:13:11 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:13:11 user nova-compute[73091]:       <nova:owner>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:user uuid="74c79b9ea11c4d108e57a04ed7052cd4">tempest-ServerActionsTestOtherB-2002245511-project-member</nova:user>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:project uuid="ca74df5f6c3643879a985989a478d33a">tempest-ServerActionsTestOtherB-2002245511</nova:project>
Aug 16 15:13:11 user nova-compute[73091]:       </nova:owner>
Aug 16 15:13:11 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:13:11 user nova-compute[73091]:       <nova:ports>
Aug 16 15:13:11 user nova-compute[73091]:         <nova:port uuid="f94a19b5-a285-4efb-9931-8f26831a7382">
Aug 16 15:13:11 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:13:11 user nova-compute[73091]:         </nova:port>
Aug 16 15:13:11 user nova-compute[73091]:       </nova:ports>
Aug 16 15:13:11 user nova-compute[73091]:     </nova:instance>
Aug 16 15:13:11 user nova-compute[73091]:   </metadata>
Aug 16 15:13:11 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:13:11 user nova-compute[73091]:     <system>
Aug 16 15:13:11 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:13:11 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:13:11 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:13:11 user nova-compute[73091]:       <entry name="serial">a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</entry>
Aug 16 15:13:11 user nova-compute[73091]:       <entry name="uuid">a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</entry>
Aug 16 15:13:11 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:13:11 user nova-compute[73091]:     </system>
Aug 16 15:13:11 user nova-compute[73091]:   </sysinfo>
Aug 16 15:13:11 user nova-compute[73091]:   <os>
Aug 16 15:13:11 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:13:11 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:13:11 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:13:11 user nova-compute[73091]:   </os>
Aug 16 15:13:11 user nova-compute[73091]:   <features>
Aug 16 15:13:11 user nova-compute[73091]:     <acpi/>
Aug 16 15:13:11 user nova-compute[73091]:     <apic/>
Aug 16 15:13:11 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:13:11 user nova-compute[73091]:   </features>
Aug 16 15:13:11 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:13:11 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:13:11 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:13:11 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:13:11 user nova-compute[73091]:   </clock>
Aug 16 15:13:11 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:13:11 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:13:11 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:13:11 user nova-compute[73091]:   </cpu>
Aug 16 15:13:11 user nova-compute[73091]:   <devices>
Aug 16 15:13:11 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:13:11 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:13:11 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk"/>
Aug 16 15:13:11 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:13:11 user nova-compute[73091]:     </disk>
Aug 16 15:13:11 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:13:11 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:13:11 user nova-compute[73091]:       <source dev="/dev/sdf"/>
Aug 16 15:13:11 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:13:11 user nova-compute[73091]:       <serial>bf6502f7-b3a5-4ada-9afe-2c2762bf3e67</serial>
Aug 16 15:13:11 user nova-compute[73091]:     </disk>
Aug 16 15:13:11 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:13:11 user nova-compute[73091]:       <mac address="fa:16:3e:05:9f:63"/>
Aug 16 15:13:11 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:11 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:13:11 user nova-compute[73091]:       <target dev="tapf94a19b5-a2"/>
Aug 16 15:13:11 user nova-compute[73091]:     </interface>
Aug 16 15:13:11 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:13:11 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/console.log" append="off"/>
Aug 16 15:13:11 user nova-compute[73091]:     </serial>
Aug 16 15:13:11 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:13:11 user nova-compute[73091]:     <video>
Aug 16 15:13:11 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:11 user nova-compute[73091]:     </video>
Aug 16 15:13:11 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:13:11 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:13:11 user nova-compute[73091]:     </rng>
Aug 16 15:13:11 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:13:11 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:13:11 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:13:11 user nova-compute[73091]:     </memballoon>
Aug 16 15:13:11 user nova-compute[73091]:   </devices>
Aug 16 15:13:11 user nova-compute[73091]: </domain>
Aug 16 15:13:11 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-715503273-network", "vif_mac": "fa:16:3e:05:9f:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG os_vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf94a19b5-a2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf94a19b5-a2, col_values=(('external_ids', {'iface-id': 'f94a19b5-a285-4efb-9931-8f26831a7382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9f:63', 'vm-uuid': 'a42f48f4-9a4e-4b6f-b61c-59b8ba7de752'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:11 user nova-compute[73091]: INFO os_vif [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2')
Aug 16 15:13:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] No VIF found with MAC fa:16:3e:05:9f:63, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:13:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198796.015113, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Resumed (Lifecycle Event)
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198777.3512192, 8263a95b-fe6a-45c8-a94e-dccd6ec5f623 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] VM Stopped (Lifecycle Event)
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ab2ccb5-cc16-480e-a8b6-a106fcc57cb7 req-3e886fed-1d86-4d26-a9a7-7cd3e4d3b567 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ab2ccb5-cc16-480e-a8b6-a106fcc57cb7 req-3e886fed-1d86-4d26-a9a7-7cd3e4d3b567 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ab2ccb5-cc16-480e-a8b6-a106fcc57cb7 req-3e886fed-1d86-4d26-a9a7-7cd3e4d3b567 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ab2ccb5-cc16-480e-a8b6-a106fcc57cb7 req-3e886fed-1d86-4d26-a9a7-7cd3e4d3b567 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ab2ccb5-cc16-480e-a8b6-a106fcc57cb7 req-3e886fed-1d86-4d26-a9a7-7cd3e4d3b567 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:16 user nova-compute[73091]: WARNING nova.compute.manager [req-3ab2ccb5-cc16-480e-a8b6-a106fcc57cb7 req-3e886fed-1d86-4d26-a9a7-7cd3e4d3b567 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state active and task_state resize_finish.
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing instance network info cache due to event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-68c5263c-7693-4bfa-8d56-74c600d59e29 req-f79e5700-5191-4c79-8c66-040e3e8ad3d9 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-68c5263c-7693-4bfa-8d56-74c600d59e29 req-f79e5700-5191-4c79-8c66-040e3e8ad3d9 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-68c5263c-7693-4bfa-8d56-74c600d59e29 req-f79e5700-5191-4c79-8c66-040e3e8ad3d9 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-68c5263c-7693-4bfa-8d56-74c600d59e29 req-f79e5700-5191-4c79-8c66-040e3e8ad3d9 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-68c5263c-7693-4bfa-8d56-74c600d59e29 req-f79e5700-5191-4c79-8c66-040e3e8ad3d9 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:16 user nova-compute[73091]: WARNING nova.compute.manager [req-68c5263c-7693-4bfa-8d56-74c600d59e29 req-f79e5700-5191-4c79-8c66-040e3e8ad3d9 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state active and task_state resize_finish.
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-65b77dd0-63fe-4f7e-bc9d-87c57689743b None None] [instance: 8263a95b-fe6a-45c8-a94e-dccd6ec5f623] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance running successfully.
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=6963MB free_disk=25.05221939086914GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Failed to set time: agent not configured {{(pid=73091) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4fb2777-d61e-476c-8465-1aa2a967c9ae tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] finish_migration finished successfully. {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198796.017704, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Started (Lifecycle Event)
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Applying migration context for instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 as it has an incoming, in-progress migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f. Migration status is post-migrating {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 15:13:16 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating resource usage from migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7d8df62-ad41-488e-9612-287fee103229 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9a040d49-3d4e-4496-b546-2daf1bf56978 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 0501f6bc-55a5-4112-9036-1f05880cdd8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7b091903-0cb2-4e1e-9df9-a7570facb46e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:13:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updated VIF entry in instance network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98e6a38f-938c-4f87-9991-686245750814 req-e514a6e3-5062-467b-95d0-8a9636f88f28 service nova] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.903s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing instance network info cache due to event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:13:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updated VIF entry in instance network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:13:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cd561ea6-ce8c-487c-b4f1-89620000683a req-db8503f2-c5ac-4a9b-a11b-c1ef7561efae service nova] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:13:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:13:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:25 user nova-compute[73091]: INFO nova.compute.manager [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Rebooting instance
Aug 16 15:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:13:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4303eeb-daaa-45b7-a346-141103dfc1e9 req-1b114528-d403-4440-9fa8-dc384ce35b75 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-unplugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4303eeb-daaa-45b7-a346-141103dfc1e9 req-1b114528-d403-4440-9fa8-dc384ce35b75 service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4303eeb-daaa-45b7-a346-141103dfc1e9 req-1b114528-d403-4440-9fa8-dc384ce35b75 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4303eeb-daaa-45b7-a346-141103dfc1e9 req-1b114528-d403-4440-9fa8-dc384ce35b75 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4303eeb-daaa-45b7-a346-141103dfc1e9 req-1b114528-d403-4440-9fa8-dc384ce35b75 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-unplugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:26 user nova-compute[73091]: WARNING nova.compute.manager [req-c4303eeb-daaa-45b7-a346-141103dfc1e9 req-1b114528-d403-4440-9fa8-dc384ce35b75 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-unplugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:13:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance destroyed successfully.
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'resources' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638607342',display_name='tempest-TestMinimumBasicScenario-server-1638607342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638607342',id=27,image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKedjQhiPAMOu3U+iG2SKYrvhmX9Dtktr6EkdHGsqnbuJIWesNok+5qdq5FnXXNXNAey6PPPcUZ9yAuEjiKBULfrO/tYJkZzzU6dQfQZvYtSVkZMjHTmWs+sFalApouOAA==',key_name='tempest-TestMinimumBasicScenario-1184341503',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-tgbq8n5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:13:26Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=b7d8df62-ad41-488e-9612-287fee103229,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56ae74d8-0d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:27 user nova-compute[73091]: INFO os_vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d')
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06206883-19a8-4c37-96c3-eef6bab827b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd5387-44c6-4c33-88a3-5f2135538687]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c374040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a78fde-620c-49e3-8424-4fc8c8dd9190]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adfcf00-767b-4de0-b443-900bf437e4c7]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e6869-9aa0-41d2-8450-e7d278b92060]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c200af4-b9c9-473d-8b3a-17323abaae79]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f82ee0-ef42-40d1-993c-34761dec2986]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7031ea6-9161-45f6-a52a-091f1e2e4c98]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]
Aug 16 15:13:27 user nova-compute[73091]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6449a26-8d61-4fdd-b25e-57999e17974a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== disconnect_volume: return (340ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Start _get_guest_xml network_info=[{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '56d114b9-3174-4545-b02e-6bd332b1dbad', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b7d8df62-ad41-488e-9612-287fee103229', 'attached_at': '', 'detached_at': '', 'volume_id': '5b38c794-c8e4-4755-b10d-b8269908ee50', 'serial': '5b38c794-c8e4-4755-b10d-b8269908ee50'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:13:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:27 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[509735bb-0f03-4d72-9a52-c5be7e204343]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:13:27 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d59a29-18b8-488e-b72d-90bf0c9fe09b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50] added
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0534c-9543-457e-b083-0a495bfd8f30]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a464f9-5f5c-4279-9b86-5457ba49f5c7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioXvbwtl {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioXvbwtl" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fc38c-f718-45c6-a2de-1efacdda14ce]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ioXvbwtl'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e677f-c55c-483f-8cff-7f6981b4fb7d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdd6b09-83cc-40e2-ae29-7eabf6491486]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[750dc393-56d2-4bc9-82d7-f276c8b957d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]
Aug 16 15:13:27 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d045bc35-5411-4e46-b5df-1c5a055e9df1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72ac85f-ea1f-4c84-ab58-3ce03c18234b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9db227-c5b1-48bc-ad9b-451f11de323b]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26333363265393338', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363265393338', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-ae0b4987-95fd-4e60-8ca3-79efc0bfc78d req-26dee85a-e5dc-4659-a7f9-63cb851bd740 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ae0b4987-95fd-4e60-8ca3-79efc0bfc78d req-26dee85a-e5dc-4659-a7f9-63cb851bd740 service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ae0b4987-95fd-4e60-8ca3-79efc0bfc78d req-26dee85a-e5dc-4659-a7f9-63cb851bd740 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ae0b4987-95fd-4e60-8ca3-79efc0bfc78d req-26dee85a-e5dc-4659-a7f9-63cb851bd740 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-ae0b4987-95fd-4e60-8ca3-79efc0bfc78d req-26dee85a-e5dc-4659-a7f9-63cb851bd740 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:28 user nova-compute[73091]: WARNING nova.compute.manager [req-ae0b4987-95fd-4e60-8ca3-79efc0bfc78d req-26dee85a-e5dc-4659-a7f9-63cb851bd740 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638607342',display_name='tempest-TestMinimumBasicScenario-server-1638607342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638607342',id=27,image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKedjQhiPAMOu3U+iG2SKYrvhmX9Dtktr6EkdHGsqnbuJIWesNok+5qdq5FnXXNXNAey6PPPcUZ9yAuEjiKBULfrO/tYJkZzzU6dQfQZvYtSVkZMjHTmWs+sFalApouOAA==',key_name='tempest-TestMinimumBasicScenario-1184341503',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-tgbq8n5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:13:26Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=b7d8df62-ad41-488e-9612-287fee103229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'pci_devices' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:13:28 user nova-compute[73091]:   <uuid>b7d8df62-ad41-488e-9612-287fee103229</uuid>
Aug 16 15:13:28 user nova-compute[73091]:   <name>instance-0000001b</name>
Aug 16 15:13:28 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:13:28 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:13:28 user nova-compute[73091]:   <metadata>
Aug 16 15:13:28 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:13:28 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:13:28 user nova-compute[73091]:       <nova:name>tempest-TestMinimumBasicScenario-server-1638607342</nova:name>
Aug 16 15:13:28 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:13:27</nova:creationTime>
Aug 16 15:13:28 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:13:28 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:13:28 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:13:28 user nova-compute[73091]:       <nova:owner>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:user uuid="ceda77fdee15448c9c18cc1a1c64d0fb">tempest-TestMinimumBasicScenario-1639423549-project-member</nova:user>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:project uuid="eccc077091084e3da6c5eba044a428bd">tempest-TestMinimumBasicScenario-1639423549</nova:project>
Aug 16 15:13:28 user nova-compute[73091]:       </nova:owner>
Aug 16 15:13:28 user nova-compute[73091]:       <nova:root type="image" uuid="7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd"/>
Aug 16 15:13:28 user nova-compute[73091]:       <nova:ports>
Aug 16 15:13:28 user nova-compute[73091]:         <nova:port uuid="56ae74d8-0d8d-4492-80a2-174d2c2d85f1">
Aug 16 15:13:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 15:13:28 user nova-compute[73091]:         </nova:port>
Aug 16 15:13:28 user nova-compute[73091]:       </nova:ports>
Aug 16 15:13:28 user nova-compute[73091]:     </nova:instance>
Aug 16 15:13:28 user nova-compute[73091]:   </metadata>
Aug 16 15:13:28 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:13:28 user nova-compute[73091]:     <system>
Aug 16 15:13:28 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:13:28 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:13:28 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:13:28 user nova-compute[73091]:       <entry name="serial">b7d8df62-ad41-488e-9612-287fee103229</entry>
Aug 16 15:13:28 user nova-compute[73091]:       <entry name="uuid">b7d8df62-ad41-488e-9612-287fee103229</entry>
Aug 16 15:13:28 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:13:28 user nova-compute[73091]:     </system>
Aug 16 15:13:28 user nova-compute[73091]:   </sysinfo>
Aug 16 15:13:28 user nova-compute[73091]:   <os>
Aug 16 15:13:28 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:13:28 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:13:28 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:13:28 user nova-compute[73091]:   </os>
Aug 16 15:13:28 user nova-compute[73091]:   <features>
Aug 16 15:13:28 user nova-compute[73091]:     <acpi/>
Aug 16 15:13:28 user nova-compute[73091]:     <apic/>
Aug 16 15:13:28 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:13:28 user nova-compute[73091]:   </features>
Aug 16 15:13:28 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:13:28 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:13:28 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:13:28 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:13:28 user nova-compute[73091]:   </clock>
Aug 16 15:13:28 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:13:28 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:13:28 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:13:28 user nova-compute[73091]:   </cpu>
Aug 16 15:13:28 user nova-compute[73091]:   <devices>
Aug 16 15:13:28 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:13:28 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:13:28 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk"/>
Aug 16 15:13:28 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:13:28 user nova-compute[73091]:     </disk>
Aug 16 15:13:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:13:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:13:28 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 16 15:13:28 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:13:28 user nova-compute[73091]:       <serial>5b38c794-c8e4-4755-b10d-b8269908ee50</serial>
Aug 16 15:13:28 user nova-compute[73091]:     </disk>
Aug 16 15:13:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:13:28 user nova-compute[73091]:       <mac address="fa:16:3e:b0:f8:d9"/>
Aug 16 15:13:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:13:28 user nova-compute[73091]:       <target dev="tap56ae74d8-0d"/>
Aug 16 15:13:28 user nova-compute[73091]:     </interface>
Aug 16 15:13:28 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:13:28 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/console.log" append="off"/>
Aug 16 15:13:28 user nova-compute[73091]:     </serial>
Aug 16 15:13:28 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:13:28 user nova-compute[73091]:     <video>
Aug 16 15:13:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:28 user nova-compute[73091]:     </video>
Aug 16 15:13:28 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:13:28 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:13:28 user nova-compute[73091]:     </rng>
Aug 16 15:13:28 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:13:28 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:13:28 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:13:28 user nova-compute[73091]:     </memballoon>
Aug 16 15:13:28 user nova-compute[73091]:   </devices>
Aug 16 15:13:28 user nova-compute[73091]: </domain>
Aug 16 15:13:28 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Cannot resize image /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'migration_context' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638607342',display_name='tempest-TestMinimumBasicScenario-server-1638607342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638607342',id=27,image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKedjQhiPAMOu3U+iG2SKYrvhmX9Dtktr6EkdHGsqnbuJIWesNok+5qdq5FnXXNXNAey6PPPcUZ9yAuEjiKBULfrO/tYJkZzzU6dQfQZvYtSVkZMjHTmWs+sFalApouOAA==',key_name='tempest-TestMinimumBasicScenario-1184341503',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-tgbq8n5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:13:26Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=b7d8df62-ad41-488e-9612-287fee103229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG os_vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56ae74d8-0d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56ae74d8-0d, col_values=(('external_ids', {'iface-id': '56ae74d8-0d8d-4492-80a2-174d2c2d85f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f8:d9', 'vm-uuid': 'b7d8df62-ad41-488e-9612-287fee103229'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:29 user nova-compute[73091]: INFO os_vif [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d')
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-77f840e9-582c-45f5-8c91-0d41290726c0 req-fee11e6c-ddd8-4cf4-a1f4-733b074c86c7 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-77f840e9-582c-45f5-8c91-0d41290726c0 req-fee11e6c-ddd8-4cf4-a1f4-733b074c86c7 service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-77f840e9-582c-45f5-8c91-0d41290726c0 req-fee11e6c-ddd8-4cf4-a1f4-733b074c86c7 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-77f840e9-582c-45f5-8c91-0d41290726c0 req-fee11e6c-ddd8-4cf4-a1f4-733b074c86c7 service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-77f840e9-582c-45f5-8c91-0d41290726c0 req-fee11e6c-ddd8-4cf4-a1f4-733b074c86c7 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:31 user nova-compute[73091]: WARNING nova.compute.manager [req-77f840e9-582c-45f5-8c91-0d41290726c0 req-fee11e6c-ddd8-4cf4-a1f4-733b074c86c7 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b1181bba-9e8e-4c05-931f-512be1424503 req-3f087a31-a8a0-4637-a985-331183b4216e service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b1181bba-9e8e-4c05-931f-512be1424503 req-3f087a31-a8a0-4637-a985-331183b4216e service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b1181bba-9e8e-4c05-931f-512be1424503 req-3f087a31-a8a0-4637-a985-331183b4216e service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b1181bba-9e8e-4c05-931f-512be1424503 req-3f087a31-a8a0-4637-a985-331183b4216e service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b1181bba-9e8e-4c05-931f-512be1424503 req-3f087a31-a8a0-4637-a985-331183b4216e service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:33 user nova-compute[73091]: WARNING nova.compute.manager [req-b1181bba-9e8e-4c05-931f-512be1424503 req-3f087a31-a8a0-4637-a985-331183b4216e service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for b7d8df62-ad41-488e-9612-287fee103229 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198813.630348, b7d8df62-ad41-488e-9612-287fee103229 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:33 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] VM Resumed (Lifecycle Event)
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:13:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance rebooted successfully.
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:33 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198813.6315057, b7d8df62-ad41-488e-9612-287fee103229 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:33 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] VM Started (Lifecycle Event)
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2768081e-061b-4d6a-af1a-d7c6943d1150 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.566s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-changed-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Refreshing instance network info cache due to event network-changed-64727212-d669-4510-b13d-3727fc797a2e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] Acquiring lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] Acquired lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Refreshing network info cache for port 64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'flavor' on Instance uuid 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Ignoring supplied device name: /dev/vdb
Aug 16 15:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:37 user nova-compute[73091]: INFO nova.compute.manager [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Attaching volume 476ae106-e604-41a5-a5bd-6dd36e7e1073 to /dev/vdb
Aug 16 15:13:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updated VIF entry in instance network info cache for port 64727212-d669-4510-b13d-3727fc797a2e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updating instance_info_cache with network_info: [{"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f813864c-db3b-4949-9aac-6dd67cb84ae5 req-f2a3c6ba-8a8c-44c7-b6fb-4d81463c9662 service nova] Releasing lock "refresh_cache-9a040d49-3d4e-4496-b546-2daf1bf56978" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd14db9-df55-46cd-8162-49368153319f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3382d87d-94d1-42ea-a4b5-d52e32be22c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26672041-81e3-4e50-8312-a27985ad025d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e19d5-4bd6-4b8a-aca6-a1cfe5e58a9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:13:37 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:13:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa0fcc7-b55c-42f6-bb54-5bb27949cd44]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updating existing volume attachment record: 3b49e1b4-2e17-4cf0-80c8-f442cffdf09c {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:13:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-changed-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Refreshing instance network info cache due to event network-changed-f545ab0e-caf2-473a-9102-c541e4b40bda. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:13:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] Acquiring lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] Acquired lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Refreshing network info cache for port f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:13:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updated VIF entry in instance network info cache for port f545ab0e-caf2-473a-9102-c541e4b40bda. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:13:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updating instance_info_cache with network_info: [{"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-816c6457-7f5f-421d-832b-d7d088149559 req-1b4dd4a2-a4c1-4315-aec3-ed06cee39604 service nova] Releasing lock "refresh_cache-0501f6bc-55a5-4112-9036-1f05880cdd8b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Rescuing
Aug 16 15:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:13:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updating instance_info_cache with network_info: [{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-d64b4bd1-8544-4e28-95b3-4375d8ff52f2 req-18012968-30d3-4216-9a24-c33fd84083ac service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d64b4bd1-8544-4e28-95b3-4375d8ff52f2 req-18012968-30d3-4216-9a24-c33fd84083ac service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d64b4bd1-8544-4e28-95b3-4375d8ff52f2 req-18012968-30d3-4216-9a24-c33fd84083ac service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d64b4bd1-8544-4e28-95b3-4375d8ff52f2 req-18012968-30d3-4216-9a24-c33fd84083ac service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-d64b4bd1-8544-4e28-95b3-4375d8ff52f2 req-18012968-30d3-4216-9a24-c33fd84083ac service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:40 user nova-compute[73091]: WARNING nova.compute.manager [req-d64b4bd1-8544-4e28-95b3-4375d8ff52f2 req-18012968-30d3-4216-9a24-c33fd84083ac service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state active and task_state rescuing.
Aug 16 15:13:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance destroyed successfully.
Aug 16 15:13:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Attempting a stable device rescue
Aug 16 15:13:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 15:13:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:13:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Creating image(s)
Aug 16 15:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "/opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "3033bb9daf0460f21cfbc882875b4aa82d561093" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "3033bb9daf0460f21cfbc882875b4aa82d561093" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-d083e47c-0be4-4f34-be95-8339f6c958c7 req-ccd5e500-3ffe-42df-9fea-34f44555e83a service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d083e47c-0be4-4f34-be95-8339f6c958c7 req-ccd5e500-3ffe-42df-9fea-34f44555e83a service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d083e47c-0be4-4f34-be95-8339f6c958c7 req-ccd5e500-3ffe-42df-9fea-34f44555e83a service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d083e47c-0be4-4f34-be95-8339f6c958c7 req-ccd5e500-3ffe-42df-9fea-34f44555e83a service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-d083e47c-0be4-4f34-be95-8339f6c958c7 req-ccd5e500-3ffe-42df-9fea-34f44555e83a service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:42 user nova-compute[73091]: WARNING nova.compute.manager [req-d083e47c-0be4-4f34-be95-8339f6c958c7 req-ccd5e500-3ffe-42df-9fea-34f44555e83a service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state active and task_state rescuing.
Aug 16 15:13:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.part --force-share --output=json" returned: 0 in 0.267s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG nova.virt.images [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] 69ae9c21-9e4d-472d-bac1-429b78a110ba was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.part /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.part /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.converted" returned: 0 in 0.863s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "3033bb9daf0460f21cfbc882875b4aa82d561093" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.825s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "3033bb9daf0460f21cfbc882875b4aa82d561093" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "3033bb9daf0460f21cfbc882875b4aa82d561093" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093 --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093,backing_fmt=raw /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093,backing_fmt=raw /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue" returned: 0 in 0.056s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "3033bb9daf0460f21cfbc882875b4aa82d561093" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'migration_context' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Start _get_guest_xml network_info=[{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "vif_mac": "fa:16:3e:1f:3b:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '69ae9c21-9e4d-472d-bac1-429b78a110ba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '55978f8a-c759-4947-b1c6-800ac940aa03', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c6017245-2e44-4fd0-9760-2b8f2e9f6df2', 'attached_at': '', 'detached_at': '', 'volume_id': '4947e013-c893-4747-8d39-619ae7f31d7d', 'serial': '4947e013-c893-4747-8d39-619ae7f31d7d'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'resources' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'numa_topology' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:44 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:44 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:44 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:44 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:44 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7345b831-a5a5-4857-a28e-cb9672f988b2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FsQSHbpd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 15:13:44 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d
Aug 16 15:13:44 user nova-compute[73091]: node.tpgt = -1
Aug 16 15:13:44 user nova-compute[73091]: node.startup = automatic
Aug 16 15:13:44 user nova-compute[73091]: node.leading_login = No
Aug 16 15:13:44 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 16 15:13:44 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.prefix_len = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.transport_name = tcp
Aug 16 15:13:44 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.vlan_id = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.vlan_priority = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.iface_num = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.mtu = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.port = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.bootproto = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.gateway = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.tos_state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.tos = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.ttl = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.redirect = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.header_digest = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.data_digest = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.erl = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.first_burst_len = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.max_burst_len = 0
Aug 16 15:13:44 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 16 15:13:44 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 16 15:13:44 user nova-compute[73091]: node.discovery_address = <empty>
Aug 16 15:13:44 user nova-compute[73091]: node.discovery_port = 0
Aug 16 15:13:44 user nova-compute[73091]: node.discovery_type = static
Aug 16 15:13:44 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 16 15:13:44 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 16 15:13:44 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 16 15:13:44 user nova-compute[73091]: node.session.cmds_max = 128
Aug 16 15:13:44 user nova-compute[73091]: node.session.queue_depth = 32
Aug 16 15:13:44 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 16 15:13:44 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 16 15:13:44 user nova-compute[73091]: node.session.auth.username = FsQSHbpd
Aug 16 15:13:44 user nova-compute[73091]: node.session.auth.password = ***
Aug 16 15:13:44 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 16 15:13:44 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 16 15:13:44 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 16 15:13:44 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 16 15:13:44 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 16 15:13:44 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 15:13:44 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 15:13:44 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 15:13:44 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 16 15:13:44 user nova-compute[73091]: node.session.scan = manual
Aug 16 15:13:44 user nova-compute[73091]: node.session.reopen_max = 0
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].port = 3260
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].startup = manual
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 16 15:13:44 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 16 15:13:44 user nova-compute[73091]: # END RECORD
Aug 16 15:13:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374ca1e-aa60-4490-b56a-3572778b6d79]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7498470a-2cd7-4ceb-825d-539dea45f8cd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsQSHbpd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsQSHbpd" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5b4cf-a239-4d6e-bc87-c3634c2f97f8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsQSHbpd'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[653aa198-fefb-4c46-add9-f8e62f9ed70e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[babdd9ac-8819-4c15-84ef-176410d0def6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.193s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] HCTL ('33', '0', '0', 0) found on session 27 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c21a8f-2db5-4d1c-840e-4f0025d597c2]: (4, ('0 0 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Searching for a device in session 27 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.220s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== connect_volume: return (222ms) {'type': 'block', 'scsi_wwn': '23463373533646538', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463373533646538', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1387492187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1387492187',id=30,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-iz7v0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:12:19Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=c6017245-2e44-4fd0-9760-2b8f2e9f6df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "vif_mac": "fa:16:3e:1f:3b:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "vif_mac": "fa:16:3e:1f:3b:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'pci_devices' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:13:44 user nova-compute[73091]:   <uuid>c6017245-2e44-4fd0-9760-2b8f2e9f6df2</uuid>
Aug 16 15:13:44 user nova-compute[73091]:   <name>instance-0000001e</name>
Aug 16 15:13:44 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:13:44 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:13:44 user nova-compute[73091]:   <metadata>
Aug 16 15:13:44 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:13:44 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:13:44 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1387492187</nova:name>
Aug 16 15:13:44 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:13:44</nova:creationTime>
Aug 16 15:13:44 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:13:44 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:13:44 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:13:44 user nova-compute[73091]:       <nova:owner>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:user uuid="c0243ed66e484f6a820421b1f69ece02">tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member</nova:user>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:project uuid="7c4d07f3079144a59f93086e00017115">tempest-ServerBootFromVolumeStableRescueTest-909556237</nova:project>
Aug 16 15:13:44 user nova-compute[73091]:       </nova:owner>
Aug 16 15:13:44 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:13:44 user nova-compute[73091]:       <nova:ports>
Aug 16 15:13:44 user nova-compute[73091]:         <nova:port uuid="e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc">
Aug 16 15:13:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:13:44 user nova-compute[73091]:         </nova:port>
Aug 16 15:13:44 user nova-compute[73091]:       </nova:ports>
Aug 16 15:13:44 user nova-compute[73091]:     </nova:instance>
Aug 16 15:13:44 user nova-compute[73091]:   </metadata>
Aug 16 15:13:44 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:13:44 user nova-compute[73091]:     <system>
Aug 16 15:13:44 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:13:44 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:13:44 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:13:44 user nova-compute[73091]:       <entry name="serial">c6017245-2e44-4fd0-9760-2b8f2e9f6df2</entry>
Aug 16 15:13:44 user nova-compute[73091]:       <entry name="uuid">c6017245-2e44-4fd0-9760-2b8f2e9f6df2</entry>
Aug 16 15:13:44 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:13:44 user nova-compute[73091]:     </system>
Aug 16 15:13:44 user nova-compute[73091]:   </sysinfo>
Aug 16 15:13:44 user nova-compute[73091]:   <os>
Aug 16 15:13:44 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:13:44 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:13:44 user nova-compute[73091]:   </os>
Aug 16 15:13:44 user nova-compute[73091]:   <features>
Aug 16 15:13:44 user nova-compute[73091]:     <acpi/>
Aug 16 15:13:44 user nova-compute[73091]:     <apic/>
Aug 16 15:13:44 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:13:44 user nova-compute[73091]:   </features>
Aug 16 15:13:44 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:13:44 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:13:44 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:13:44 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:13:44 user nova-compute[73091]:   </clock>
Aug 16 15:13:44 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:13:44 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:13:44 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:13:44 user nova-compute[73091]:   </cpu>
Aug 16 15:13:44 user nova-compute[73091]:   <devices>
Aug 16 15:13:44 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:13:44 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:13:44 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:13:44 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:13:44 user nova-compute[73091]:       <serial>4947e013-c893-4747-8d39-619ae7f31d7d</serial>
Aug 16 15:13:44 user nova-compute[73091]:     </disk>
Aug 16 15:13:44 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:13:44 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:13:44 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue"/>
Aug 16 15:13:44 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:13:44 user nova-compute[73091]:       <boot order="1"/>
Aug 16 15:13:44 user nova-compute[73091]:     </disk>
Aug 16 15:13:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:13:44 user nova-compute[73091]:       <mac address="fa:16:3e:1f:3b:92"/>
Aug 16 15:13:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:13:44 user nova-compute[73091]:       <target dev="tape9c19b22-d6"/>
Aug 16 15:13:44 user nova-compute[73091]:     </interface>
Aug 16 15:13:44 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:13:44 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/console.log" append="off"/>
Aug 16 15:13:44 user nova-compute[73091]:     </serial>
Aug 16 15:13:44 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:13:44 user nova-compute[73091]:     <video>
Aug 16 15:13:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:44 user nova-compute[73091]:     </video>
Aug 16 15:13:44 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:13:44 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:13:44 user nova-compute[73091]:     </rng>
Aug 16 15:13:44 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:13:44 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:13:44 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:13:44 user nova-compute[73091]:     </memballoon>
Aug 16 15:13:44 user nova-compute[73091]:   </devices>
Aug 16 15:13:44 user nova-compute[73091]: </domain>
Aug 16 15:13:44 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:13:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance destroyed successfully.
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] No VIF found with MAC fa:16:3e:1f:3b:92, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:13:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lazy-loading 'flavor' on Instance uuid 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:45 user nova-compute[73091]: INFO nova.compute.manager [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Attaching volume c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 to /dev/vdb
Aug 16 15:13:45 user nova-compute[73091]: DEBUG os_brick.utils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c8bd6c-d2cf-4b0e-b9b3-32514a54ae13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[704d31b7-85be-47ee-9988-e3c839ee955c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe83992-33ad-40be-8231-10f50144ac2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3108e67-8be9-47a1-b596-da381af57404]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:13:45 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:13:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541af3d-ce41-47e6-8c34-05d211912245]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG os_brick.utils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:45 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updating existing volume attachment record: bd050b34-04e6-44ee-8ec3-b178b9ef2f6c {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-6badd92f-26c7-42c9-a001-f073f84b7d29 req-a741d707-3341-4fd8-aede-9e9e0681c993 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6badd92f-26c7-42c9-a001-f073f84b7d29 req-a741d707-3341-4fd8-aede-9e9e0681c993 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6badd92f-26c7-42c9-a001-f073f84b7d29 req-a741d707-3341-4fd8-aede-9e9e0681c993 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6badd92f-26c7-42c9-a001-f073f84b7d29 req-a741d707-3341-4fd8-aede-9e9e0681c993 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-6badd92f-26c7-42c9-a001-f073f84b7d29 req-a741d707-3341-4fd8-aede-9e9e0681c993 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:46 user nova-compute[73091]: WARNING nova.compute.manager [req-6badd92f-26c7-42c9-a001-f073f84b7d29 req-a741d707-3341-4fd8-aede-9e9e0681c993 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state active and task_state rescuing.
Aug 16 15:13:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd787038-cbd7-470a-99a1-dadc013e676b req-f5a630d4-e58d-436e-b4c1-bcc1721f0f71 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd787038-cbd7-470a-99a1-dadc013e676b req-f5a630d4-e58d-436e-b4c1-bcc1721f0f71 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd787038-cbd7-470a-99a1-dadc013e676b req-f5a630d4-e58d-436e-b4c1-bcc1721f0f71 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd787038-cbd7-470a-99a1-dadc013e676b req-f5a630d4-e58d-436e-b4c1-bcc1721f0f71 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd787038-cbd7-470a-99a1-dadc013e676b req-f5a630d4-e58d-436e-b4c1-bcc1721f0f71 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:48 user nova-compute[73091]: WARNING nova.compute.manager [req-fd787038-cbd7-470a-99a1-dadc013e676b req-f5a630d4-e58d-436e-b4c1-bcc1721f0f71 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state active and task_state rescuing.
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for c6017245-2e44-4fd0-9760-2b8f2e9f6df2 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198828.543282, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:48 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Resumed (Lifecycle Event)
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1428baaa-68b4-4e22-a3c0-bd062b8fb37c tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:48 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198828.5435207, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:48 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Started (Lifecycle Event)
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:13:51 user nova-compute[73091]: INFO nova.compute.claims [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Claim successful on node user
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:13:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.policy [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f6775ee1ca44360920397fd8bbf2899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c198a130ace46eca27de708de492ef7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:13:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Creating image(s)
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.251s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Successfully created port: 7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Cannot resize image /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'migration_context' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Ensure instance console log exists: /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCHLxIyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:53 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac493d70-7c6f-44d3-882e-e5a988b9be5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:13:53 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[227290e7-06fb-42b1-b2d7-a0d0b940822e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073] added
Aug 16 15:13:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51132842-0559-488b-b2f5-98c43c029ac7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aff633-64b2-4683-8557-777eba8178be]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCHLxIyN {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCHLxIyN" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[911fb709-5790-4ccd-801f-53f15f9a24a4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZCHLxIyN'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4be20e5-b099-4f0b-a517-322af8bdc651]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4e5f3e-490d-4b17-89b1-95a16680575c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48080d8-cd15-4918-bdf0-cb18cbbafb3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260]
Aug 16 15:13:53 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260] successful.
Aug 16 15:13:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de1579-b251-42f3-afeb-53583b659db1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a3b3a-e539-4a7f-943b-ed53b6b75046]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:13:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1572e32d-8c22-4fcf-a69f-2b315997c40e]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Successfully updated port: 7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing instance network info cache due to event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance network_info: |[{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Start _get_guest_xml network_info=[{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:13:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937008942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937008942',id=33,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/DBgrLgwI4zaI4rWEC7+z1vkl35C8R5oYUvNcjwjH/UMTG020zjicREFf371y90owyPLCU9gC8skIVbMioQyFgHe1GnSQeADg1+pqGObzKo3NYGuX/1fl9pGFsZ7HAA==',key_name='tempest-keypair-1222551489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-yytgy2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=e1867285-e33a-4b24-8f9e-96886a018a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'pci_devices' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:13:54 user nova-compute[73091]:   <uuid>e1867285-e33a-4b24-8f9e-96886a018a90</uuid>
Aug 16 15:13:54 user nova-compute[73091]:   <name>instance-00000021</name>
Aug 16 15:13:54 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:13:54 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:13:54 user nova-compute[73091]:   <metadata>
Aug 16 15:13:54 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:13:54 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:13:54 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1937008942</nova:name>
Aug 16 15:13:54 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:13:54</nova:creationTime>
Aug 16 15:13:54 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:13:54 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:13:54 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:13:54 user nova-compute[73091]:       <nova:owner>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:user uuid="0f6775ee1ca44360920397fd8bbf2899">tempest-AttachVolumeShelveTestJSON-1996332630-project-member</nova:user>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:project uuid="0c198a130ace46eca27de708de492ef7">tempest-AttachVolumeShelveTestJSON-1996332630</nova:project>
Aug 16 15:13:54 user nova-compute[73091]:       </nova:owner>
Aug 16 15:13:54 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:13:54 user nova-compute[73091]:       <nova:ports>
Aug 16 15:13:54 user nova-compute[73091]:         <nova:port uuid="7c487e54-2a45-431e-8ac2-0d416e43db0d">
Aug 16 15:13:54 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 15:13:54 user nova-compute[73091]:         </nova:port>
Aug 16 15:13:54 user nova-compute[73091]:       </nova:ports>
Aug 16 15:13:54 user nova-compute[73091]:     </nova:instance>
Aug 16 15:13:54 user nova-compute[73091]:   </metadata>
Aug 16 15:13:54 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:13:54 user nova-compute[73091]:     <system>
Aug 16 15:13:54 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:13:54 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:13:54 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:13:54 user nova-compute[73091]:       <entry name="serial">e1867285-e33a-4b24-8f9e-96886a018a90</entry>
Aug 16 15:13:54 user nova-compute[73091]:       <entry name="uuid">e1867285-e33a-4b24-8f9e-96886a018a90</entry>
Aug 16 15:13:54 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:13:54 user nova-compute[73091]:     </system>
Aug 16 15:13:54 user nova-compute[73091]:   </sysinfo>
Aug 16 15:13:54 user nova-compute[73091]:   <os>
Aug 16 15:13:54 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:13:54 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:13:54 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:13:54 user nova-compute[73091]:   </os>
Aug 16 15:13:54 user nova-compute[73091]:   <features>
Aug 16 15:13:54 user nova-compute[73091]:     <acpi/>
Aug 16 15:13:54 user nova-compute[73091]:     <apic/>
Aug 16 15:13:54 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:13:54 user nova-compute[73091]:   </features>
Aug 16 15:13:54 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:13:54 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:13:54 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:13:54 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:13:54 user nova-compute[73091]:   </clock>
Aug 16 15:13:54 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:13:54 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:13:54 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:13:54 user nova-compute[73091]:   </cpu>
Aug 16 15:13:54 user nova-compute[73091]:   <devices>
Aug 16 15:13:54 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:13:54 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:13:54 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk"/>
Aug 16 15:13:54 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:13:54 user nova-compute[73091]:     </disk>
Aug 16 15:13:54 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:13:54 user nova-compute[73091]:       <mac address="fa:16:3e:3e:54:00"/>
Aug 16 15:13:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:54 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:13:54 user nova-compute[73091]:       <target dev="tap7c487e54-2a"/>
Aug 16 15:13:54 user nova-compute[73091]:     </interface>
Aug 16 15:13:54 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:13:54 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/console.log" append="off"/>
Aug 16 15:13:54 user nova-compute[73091]:     </serial>
Aug 16 15:13:54 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:13:54 user nova-compute[73091]:     <video>
Aug 16 15:13:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:13:54 user nova-compute[73091]:     </video>
Aug 16 15:13:54 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:13:54 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:13:54 user nova-compute[73091]:     </rng>
Aug 16 15:13:54 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:13:54 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:13:54 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:13:54 user nova-compute[73091]:     </memballoon>
Aug 16 15:13:54 user nova-compute[73091]:   </devices>
Aug 16 15:13:54 user nova-compute[73091]: </domain>
Aug 16 15:13:54 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937008942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937008942',id=33,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/DBgrLgwI4zaI4rWEC7+z1vkl35C8R5oYUvNcjwjH/UMTG020zjicREFf371y90owyPLCU9gC8skIVbMioQyFgHe1GnSQeADg1+pqGObzKo3NYGuX/1fl9pGFsZ7HAA==',key_name='tempest-keypair-1222551489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-yytgy2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=e1867285-e33a-4b24-8f9e-96886a018a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG os_vif [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c487e54-2a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c487e54-2a, col_values=(('external_ids', {'iface-id': '7c487e54-2a45-431e-8ac2-0d416e43db0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:54:00', 'vm-uuid': 'e1867285-e33a-4b24-8f9e-96886a018a90'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:54 user nova-compute[73091]: INFO os_vif [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a')
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No VIF found with MAC fa:16:3e:3e:54:00, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCHLxIyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23964376437366337', 'path': '/dev/sdh'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964376437366337', 'path': '/dev/sdh'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'flavor' on Instance uuid 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:13:54 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:13:54 user nova-compute[73091]:   <source dev="/dev/sdh"/>
Aug 16 15:13:54 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:13:54 user nova-compute[73091]:   <serial>476ae106-e604-41a5-a5bd-6dd36e7e1073</serial>
Aug 16 15:13:54 user nova-compute[73091]: </disk>
Aug 16 15:13:54 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updated VIF entry in instance network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-290bfeb2-b02d-4b6d-9152-f07972ee9078 req-c735b867-77af-4036-8053-b4d2c6b88aed service nova] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:13:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:13:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] No VIF found with MAC fa:16:3e:10:80:eb, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:13:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fcc5dba1-1d78-40fc-9929-b46912b1aedc tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.443s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-32e8bdb1-dcd3-4a62-8c4f-410481e25970 req-3d342f74-d4d2-4b57-b8f2-128d1a33a33a service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-32e8bdb1-dcd3-4a62-8c4f-410481e25970 req-3d342f74-d4d2-4b57-b8f2-128d1a33a33a service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-32e8bdb1-dcd3-4a62-8c4f-410481e25970 req-3d342f74-d4d2-4b57-b8f2-128d1a33a33a service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-32e8bdb1-dcd3-4a62-8c4f-410481e25970 req-3d342f74-d4d2-4b57-b8f2-128d1a33a33a service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-32e8bdb1-dcd3-4a62-8c4f-410481e25970 req-3d342f74-d4d2-4b57-b8f2-128d1a33a33a service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:56 user nova-compute[73091]: WARNING nova.compute.manager [req-32e8bdb1-dcd3-4a62-8c4f-410481e25970 req-3d342f74-d4d2-4b57-b8f2-128d1a33a33a service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state building and task_state spawning.
Aug 16 15:13:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-581b7a94-3d58-4731-8422-e50b0f82703f req-9512f325-68cf-4ccd-a5bc-7348bcf769e4 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-581b7a94-3d58-4731-8422-e50b0f82703f req-9512f325-68cf-4ccd-a5bc-7348bcf769e4 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-581b7a94-3d58-4731-8422-e50b0f82703f req-9512f325-68cf-4ccd-a5bc-7348bcf769e4 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-581b7a94-3d58-4731-8422-e50b0f82703f req-9512f325-68cf-4ccd-a5bc-7348bcf769e4 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-581b7a94-3d58-4731-8422-e50b0f82703f req-9512f325-68cf-4ccd-a5bc-7348bcf769e4 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:13:58 user nova-compute[73091]: WARNING nova.compute.manager [req-581b7a94-3d58-4731-8422-e50b0f82703f req-9512f325-68cf-4ccd-a5bc-7348bcf769e4 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state building and task_state spawning.
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198838.6855805, e1867285-e33a-4b24-8f9e-96886a018a90 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] VM Resumed (Lifecycle Event)
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance spawned successfully.
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198838.6858993, e1867285-e33a-4b24-8f9e-96886a018a90 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] VM Started (Lifecycle Event)
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAFRniOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:13:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:13:58 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d531859-7a38-4da1-8526-95c911b90d7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:13:58 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[672114ce-a1a3-4009-a2b9-1d770c9ad25d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34] added
Aug 16 15:13:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 16 15:13:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f5065e-65f0-4a5f-9e45-283cb982ea8e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[daebadaa-12bb-4159-81cf-6bf61fe8b45c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uAFRniOD {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uAFRniOD" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e07b0-4591-4cfb-804c-6158c502f134]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uAFRniOD'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c0ea68-2780-4577-a796-c3965f092f09]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:58 user nova-compute[73091]: INFO nova.compute.manager [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Took 7.45 seconds to build instance.
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1c3ad-ee01-440f-816d-cb557d015af3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f29f4d78-dfa6-4258-a81f-a2870ab1f983 tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.559s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:13:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ec73bc-217e-4665-93c7-14d96f9786f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260]
Aug 16 15:13:59 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260] successful.
Aug 16 15:13:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4f236a-3a89-4174-8540-77b2ee144aa7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d779b55a-08cf-446d-bb1e-8c413601993e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 (non-flash)
Aug 16 15:13:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] HCTL ('40', '-', '-', 0) found on session 34 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec18f30-b91c-4804-8883-2ca5f91ad0c0]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:13:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAFRniOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23331363533613737', 'path': '/dev/sdi'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331363533613737', 'path': '/dev/sdi'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lazy-loading 'flavor' on Instance uuid 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:14:00 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:00 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 16 15:14:00 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:00 user nova-compute[73091]:   <serial>c4f35ba7-7d8d-4a50-a57a-3f956a78ba34</serial>
Aug 16 15:14:00 user nova-compute[73091]: </disk>
Aug 16 15:14:00 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] No VIF found with MAC fa:16:3e:fc:10:b8, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1ec5b6de-717a-4db6-b4cb-f789125f8d4e tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.144s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-changed-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Refreshing instance network info cache due to event network-changed-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Refreshing network info cache for port b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:14:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updated VIF entry in instance network info cache for port b2c5eaab-2de0-4764-9f7e-befb33ef9e7c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:14:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1b0d041-3bf3-4b97-8682-ccb1e10dcad1 req-7b0edca7-37b3-4221-adb6-6ba6874f5a1f service nova] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Stashing vm_state: active {{(pid=73091) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 15:14:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_requests' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:14:02 user nova-compute[73091]: INFO nova.compute.claims [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Claim successful on node user
Aug 16 15:14:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'resources' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:02 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating resource usage from migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f
Aug 16 15:14:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-changed-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Refreshing instance network info cache due to event network-changed-49080ee5-1f91-48ce-a4f3-c17e08515a4c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] Acquiring lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] Acquired lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Refreshing network info cache for port 49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.749s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:03 user nova-compute[73091]: INFO nova.compute.manager [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Migrating
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updated VIF entry in instance network info cache for port 49080ee5-1f91-48ce-a4f3-c17e08515a4c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74e26cbe-1b76-4d26-bb97-ab3ba2ab51af req-95729010-a5ea-44e8-9441-afd1811ceb49 service nova] Releasing lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquired lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:03 user nova-compute[73091]: INFO nova.compute.manager [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Detaching volume c4f35ba7-7d8d-4a50-a57a-3f956a78ba34
Aug 16 15:14:03 user nova-compute[73091]: INFO nova.virt.block_device [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Attempting to driver detach volume c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 from mountpoint /dev/vdb
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Attempting to detach device vdb from instance 0501f6bc-55a5-4112-9036-1f05880cdd8b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:14:03 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:03 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 16 15:14:03 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:03 user nova-compute[73091]:   <serial>c4f35ba7-7d8d-4a50-a57a-3f956a78ba34</serial>
Aug 16 15:14:03 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:14:03 user nova-compute[73091]: </disk>
Aug 16 15:14:03 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:14:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Successfully detached device vdb from instance 0501f6bc-55a5-4112-9036-1f05880cdd8b from the persistent domain config.
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0501f6bc-55a5-4112-9036-1f05880cdd8b from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:14:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:14:03 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:03 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 16 15:14:03 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:03 user nova-compute[73091]:   <serial>c4f35ba7-7d8d-4a50-a57a-3f956a78ba34</serial>
Aug 16 15:14:03 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:14:03 user nova-compute[73091]: </disk>
Aug 16 15:14:03 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Releasing lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Starting migrate_disk_and_power_off {{(pid=73091) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198844.31283, 0501f6bc-55a5-4112-9036-1f05880cdd8b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:14:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Successfully detached device vdb from instance 0501f6bc-55a5-4112-9036-1f05880cdd8b from the live domain config.
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAFRniOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664079c-a2fe-4508-83fa-d4fc262788ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b39380-09d7-4da2-b5a8-24bd8b8c0c67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 (non-flash)
Aug 16 15:14:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c57a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34'): ({'sdi'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Removing single pathed devices sdi {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c05c284-ee9e-46d0-a23e-e8d3b0077996]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ddf5f8-3a8c-48f1-9e3a-e7193e51f7c3]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Flushing IO for device /dev/sdi {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-73bf0650-14de-4d5a-a0ba-9e861b31918e req-462c4f8f-5947-4da7-811b-91f6460c3b62 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-unplugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73bf0650-14de-4d5a-a0ba-9e861b31918e req-462c4f8f-5947-4da7-811b-91f6460c3b62 service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73bf0650-14de-4d5a-a0ba-9e861b31918e req-462c4f8f-5947-4da7-811b-91f6460c3b62 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73bf0650-14de-4d5a-a0ba-9e861b31918e req-462c4f8f-5947-4da7-811b-91f6460c3b62 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-73bf0650-14de-4d5a-a0ba-9e861b31918e req-462c4f8f-5947-4da7-811b-91f6460c3b62 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-unplugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:04 user nova-compute[73091]: WARNING nova.compute.manager [req-73bf0650-14de-4d5a-a0ba-9e861b31918e req-462c4f8f-5947-4da7-811b-91f6460c3b62 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-unplugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state active and task_state resize_migrating.
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d126ffc6-2622-4d70-a579-a50d7bf27983]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.034s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce114fbd-ae78-43fb-ae90-0947f163f354]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc1e580-fa2b-4b76-aed9-4bd2c7a8c1f6]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a627db3-0348-45bf-8779-8a91ac5d2b20]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260]
Aug 16 15:14:04 user nova-compute[73091]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4f35ba7-7d8d-4a50-a57a-3f956a78ba34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d1137-b239-41f2-86a9-7409490d84e9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] <== disconnect_volume: return (349ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:14:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance destroyed successfully.
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-239578980',display_name='tempest-ServerActionsTestOtherA-server-239578980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-239578980',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-xpmo7ft2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8e6d2c04-e78d-439f-8259-e3fae71840ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49080ee5-1f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:14:04 user nova-compute[73091]: INFO os_vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f')
Aug 16 15:14:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2235076d-3020-4360-809c-05d3fd037543]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95fefe-48b8-429a-a592-5af95255ed75]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c549750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38ce317-0c5a-4db9-ad93-4a0770d2a628]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb5f779-1b69-41ea-b0ee-d65a21524e46]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c148d-96fd-41a5-88cb-48b785bb7002]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7ff08a-e538-488e-b6f9-efd6a1ec5e62]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94556b07-f50d-4247-bcd4-e558f0f48971]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb9169-a199-4ead-a328-9e6cd722b57e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]
Aug 16 15:14:05 user nova-compute[73091]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e9bfe8-f016-4569-9474-6d60e90e7e2c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== disconnect_volume: return (360ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lazy-loading 'flavor' on Instance uuid 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5d834387-be14-4c12-b4f7-9cb1c69623d1 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.905s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Port 49080ee5-1f91-48ce-a4f3-c17e08515a4c binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb3919b8-3427-4ecc-badc-9b4313275ac9 req-efd1a546-f540-4828-870d-e324f0101554 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb3919b8-3427-4ecc-badc-9b4313275ac9 req-efd1a546-f540-4828-870d-e324f0101554 service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb3919b8-3427-4ecc-badc-9b4313275ac9 req-efd1a546-f540-4828-870d-e324f0101554 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb3919b8-3427-4ecc-badc-9b4313275ac9 req-efd1a546-f540-4828-870d-e324f0101554 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb3919b8-3427-4ecc-badc-9b4313275ac9 req-efd1a546-f540-4828-870d-e324f0101554 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:06 user nova-compute[73091]: WARNING nova.compute.manager [req-fb3919b8-3427-4ecc-badc-9b4313275ac9 req-efd1a546-f540-4828-870d-e324f0101554 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state active and task_state resize_migrated.
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquired lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:14:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Releasing lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad1b13-ff9e-46ec-aeec-4a06da73cc73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c885755e-ab47-4dad-89c6-a0fd1a485187]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f293be0-db7e-4acc-9b9d-ac006c1a442e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbc2e9c-bbc3-44b9-8d0d-9a5e8ff496fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:14:07 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac6d42c-c4d4-4c59-b27a-3e93e2d2e57a]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:14:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:14:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=6658MB free_disk=24.948429107666016GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Applying migration context for instance 8e6d2c04-e78d-439f-8259-e3fae71840ba as it has an incoming, in-progress migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f. Migration status is post-migrating {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Applying migration context for instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 as it has an incoming, in-progress migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f. Migration status is finished {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 15:14:14 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating resource usage from migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f
Aug 16 15:14:14 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating resource usage from migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7d8df62-ad41-488e-9612-287fee103229 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9a040d49-3d4e-4496-b546-2daf1bf56978 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 0501f6bc-55a5-4112-9036-1f05880cdd8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7b091903-0cb2-4e1e-9df9-a7570facb46e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e1867285-e33a-4b24-8f9e-96886a018a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 18 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=12800MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=18 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:14:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:14:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:14:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:14:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.839s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updating instance_info_cache with network_info: [{"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-daf4f67c-fc4a-4386-8347-07c350412126" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Starting finish_migration {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:14:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Creating image(s)
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6d2c04-e78d-439f-8259-e3fae71840ba/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Start _get_guest_xml network_info=[{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'bdf21b3a-3eab-43f0-8b76-4e8ac202e0c9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8e6d2c04-e78d-439f-8259-e3fae71840ba', 'attached_at': '2023-08-16T15:14:19.000000', 'detached_at': '', 'volume_id': '9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6', 'serial': '9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:14:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:14:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:18 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e929f81-6e37-429d-8a28-bffd4e76388f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:14:18 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bb8197-79be-4eff-beb2-eb2e45031aab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6] added
Aug 16 15:14:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa65211-7b1c-42ac-9930-f106c5c63aeb]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b22067f-2010-4003-b5cf-7d089d72cb52]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIGfFpKv {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIGfFpKv" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ad3ad-642d-4118-9165-1289f5c47651]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIGfFpKv'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65187160-a4de-47cc-ac30-9a7a0d19a4a5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca00223-ffdc-4edd-8d37-1be7215a39ac]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e922088e-39b9-4aca-908e-ba56819c39b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]
Aug 16 15:14:19 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa34687-bae8-477e-92a0-a2015eae3285]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd46af17-5a32-4099-9247-69fc2aef99d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed527b-9c40-41a7-a7eb-fcdee2e11836]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198844.9070766, 8e6d2c04-e78d-439f-8259-e3fae71840ba => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:14:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] VM Stopped (Lifecycle Event)
Aug 16 15:14:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5b7a48d2-7d97-452f-a327-c68420775179 None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5b7a48d2-7d97-452f-a327-c68420775179 None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:14:19 user nova-compute[73091]: INFO nova.compute.manager [None req-5b7a48d2-7d97-452f-a327-c68420775179 None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 15:14:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23163663766326566', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163663766326566', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-239578980',display_name='tempest-ServerActionsTestOtherA-server-239578980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-239578980',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-xpmo7ft2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8e6d2c04-e78d-439f-8259-e3fae71840ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:14:20 user nova-compute[73091]:   <uuid>8e6d2c04-e78d-439f-8259-e3fae71840ba</uuid>
Aug 16 15:14:20 user nova-compute[73091]:   <name>instance-0000001f</name>
Aug 16 15:14:20 user nova-compute[73091]:   <memory>2097152</memory>
Aug 16 15:14:20 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:14:20 user nova-compute[73091]:   <metadata>
Aug 16 15:14:20 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:14:20 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:14:20 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-239578980</nova:name>
Aug 16 15:14:20 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:14:18</nova:creationTime>
Aug 16 15:14:20 user nova-compute[73091]:       <nova:flavor name="m1.small">
Aug 16 15:14:20 user nova-compute[73091]:         <nova:memory>2048</nova:memory>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:disk>20</nova:disk>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:14:20 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:14:20 user nova-compute[73091]:       <nova:owner>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:user uuid="40bf98e80707482a9c43719d7a56004a">tempest-ServerActionsTestOtherA-305054434-project-member</nova:user>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:project uuid="99af3ee8a3c64c50a44aa98bcdd05222">tempest-ServerActionsTestOtherA-305054434</nova:project>
Aug 16 15:14:20 user nova-compute[73091]:       </nova:owner>
Aug 16 15:14:20 user nova-compute[73091]:       <nova:ports>
Aug 16 15:14:20 user nova-compute[73091]:         <nova:port uuid="49080ee5-1f91-48ce-a4f3-c17e08515a4c">
Aug 16 15:14:20 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:14:20 user nova-compute[73091]:         </nova:port>
Aug 16 15:14:20 user nova-compute[73091]:       </nova:ports>
Aug 16 15:14:20 user nova-compute[73091]:     </nova:instance>
Aug 16 15:14:20 user nova-compute[73091]:   </metadata>
Aug 16 15:14:20 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:14:20 user nova-compute[73091]:     <system>
Aug 16 15:14:20 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:14:20 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:14:20 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:14:20 user nova-compute[73091]:       <entry name="serial">8e6d2c04-e78d-439f-8259-e3fae71840ba</entry>
Aug 16 15:14:20 user nova-compute[73091]:       <entry name="uuid">8e6d2c04-e78d-439f-8259-e3fae71840ba</entry>
Aug 16 15:14:20 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:14:20 user nova-compute[73091]:     </system>
Aug 16 15:14:20 user nova-compute[73091]:   </sysinfo>
Aug 16 15:14:20 user nova-compute[73091]:   <os>
Aug 16 15:14:20 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:14:20 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:14:20 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:14:20 user nova-compute[73091]:   </os>
Aug 16 15:14:20 user nova-compute[73091]:   <features>
Aug 16 15:14:20 user nova-compute[73091]:     <acpi/>
Aug 16 15:14:20 user nova-compute[73091]:     <apic/>
Aug 16 15:14:20 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:14:20 user nova-compute[73091]:   </features>
Aug 16 15:14:20 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:14:20 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:14:20 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:14:20 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:14:20 user nova-compute[73091]:   </clock>
Aug 16 15:14:20 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:14:20 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:14:20 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:14:20 user nova-compute[73091]:   </cpu>
Aug 16 15:14:20 user nova-compute[73091]:   <devices>
Aug 16 15:14:20 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:14:20 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:20 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 15:14:20 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:14:20 user nova-compute[73091]:       <serial>9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6</serial>
Aug 16 15:14:20 user nova-compute[73091]:     </disk>
Aug 16 15:14:20 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:14:20 user nova-compute[73091]:       <mac address="fa:16:3e:b0:68:25"/>
Aug 16 15:14:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:14:20 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:14:20 user nova-compute[73091]:       <target dev="tap49080ee5-1f"/>
Aug 16 15:14:20 user nova-compute[73091]:     </interface>
Aug 16 15:14:20 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:14:20 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8e6d2c04-e78d-439f-8259-e3fae71840ba/console.log" append="off"/>
Aug 16 15:14:20 user nova-compute[73091]:     </serial>
Aug 16 15:14:20 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:14:20 user nova-compute[73091]:     <video>
Aug 16 15:14:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:14:20 user nova-compute[73091]:     </video>
Aug 16 15:14:20 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:14:20 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:14:20 user nova-compute[73091]:     </rng>
Aug 16 15:14:20 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:14:20 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:14:20 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:14:20 user nova-compute[73091]:     </memballoon>
Aug 16 15:14:20 user nova-compute[73091]:   </devices>
Aug 16 15:14:20 user nova-compute[73091]: </domain>
Aug 16 15:14:20 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-239578980',display_name='tempest-ServerActionsTestOtherA-server-239578980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-239578980',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-xpmo7ft2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8e6d2c04-e78d-439f-8259-e3fae71840ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-524166992-network", "vif_mac": "fa:16:3e:b0:68:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG os_vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49080ee5-1f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49080ee5-1f, col_values=(('external_ids', {'iface-id': '49080ee5-1f91-48ce-a4f3-c17e08515a4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:68:25', 'vm-uuid': '8e6d2c04-e78d-439f-8259-e3fae71840ba'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:20 user nova-compute[73091]: INFO os_vif [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f')
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:14:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] No VIF found with MAC fa:16:3e:b0:68:25, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-d946961b-946b-4944-adb5-e8d964aa00a4 req-2d99eecc-c38c-43e6-b979-e72f2ae19779 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d946961b-946b-4944-adb5-e8d964aa00a4 req-2d99eecc-c38c-43e6-b979-e72f2ae19779 service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d946961b-946b-4944-adb5-e8d964aa00a4 req-2d99eecc-c38c-43e6-b979-e72f2ae19779 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d946961b-946b-4944-adb5-e8d964aa00a4 req-2d99eecc-c38c-43e6-b979-e72f2ae19779 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-d946961b-946b-4944-adb5-e8d964aa00a4 req-2d99eecc-c38c-43e6-b979-e72f2ae19779 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:21 user nova-compute[73091]: WARNING nova.compute.manager [req-d946961b-946b-4944-adb5-e8d964aa00a4 req-2d99eecc-c38c-43e6-b979-e72f2ae19779 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state active and task_state resize_finish.
Aug 16 15:14:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198863.8232148, 8e6d2c04-e78d-439f-8259-e3fae71840ba => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:14:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] VM Resumed (Lifecycle Event)
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:14:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance running successfully.
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Failed to set time: agent not configured {{(pid=73091) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de41220c-6321-4d8e-bb05-6fa4e5d9d3da tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] finish_migration finished successfully. {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:14:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198863.8243837, 8e6d2c04-e78d-439f-8259-e3fae71840ba => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:14:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] VM Started (Lifecycle Event)
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c0e34ca-b589-4582-9892-ac8937794e2d req-3731531d-7cb9-4edb-876e-10fd8ad864fd service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c0e34ca-b589-4582-9892-ac8937794e2d req-3731531d-7cb9-4edb-876e-10fd8ad864fd service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c0e34ca-b589-4582-9892-ac8937794e2d req-3731531d-7cb9-4edb-876e-10fd8ad864fd service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c0e34ca-b589-4582-9892-ac8937794e2d req-3731531d-7cb9-4edb-876e-10fd8ad864fd service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c0e34ca-b589-4582-9892-ac8937794e2d req-3731531d-7cb9-4edb-876e-10fd8ad864fd service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:23 user nova-compute[73091]: WARNING nova.compute.manager [req-7c0e34ca-b589-4582-9892-ac8937794e2d req-3731531d-7cb9-4edb-876e-10fd8ad864fd service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state active and task_state resize_finish.
Aug 16 15:14:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 15:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:30 user nova-compute[73091]: INFO nova.compute.manager [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Detaching volume 476ae106-e604-41a5-a5bd-6dd36e7e1073
Aug 16 15:14:30 user nova-compute[73091]: INFO nova.virt.block_device [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Attempting to driver detach volume 476ae106-e604-41a5-a5bd-6dd36e7e1073 from mountpoint /dev/vdb
Aug 16 15:14:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Attempting to detach device vdb from instance 9a040d49-3d4e-4496-b546-2daf1bf56978 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:14:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:14:30 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:30 user nova-compute[73091]:   <source dev="/dev/sdh"/>
Aug 16 15:14:30 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:30 user nova-compute[73091]:   <serial>476ae106-e604-41a5-a5bd-6dd36e7e1073</serial>
Aug 16 15:14:30 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:14:30 user nova-compute[73091]: </disk>
Aug 16 15:14:30 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:14:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully detached device vdb from instance 9a040d49-3d4e-4496-b546-2daf1bf56978 from the persistent domain config.
Aug 16 15:14:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a040d49-3d4e-4496-b546-2daf1bf56978 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:14:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:14:30 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:30 user nova-compute[73091]:   <source dev="/dev/sdh"/>
Aug 16 15:14:30 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:30 user nova-compute[73091]:   <serial>476ae106-e604-41a5-a5bd-6dd36e7e1073</serial>
Aug 16 15:14:30 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:14:30 user nova-compute[73091]: </disk>
Aug 16 15:14:30 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:14:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198871.3283694, 9a040d49-3d4e-4496-b546-2daf1bf56978 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:14:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully detached device vdb from instance 9a040d49-3d4e-4496-b546-2daf1bf56978 from the live domain config.
Aug 16 15:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCHLxIyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[003cf6c0-d54a-4ab6-a013-714b2a6f530b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7971be6b-d832-49ea-b137-0ee939463782]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c6ca200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073'): ({'sdh'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Removing single pathed devices sdh {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a265c-2ff2-4a1b-9256-916d3466ae5a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1161e9-8715-4a53-b03c-1d6ff5b0ec3e]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Flushing IO for device /dev/sdh {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261ce85-fc99-4f95-97e4-926cd2bc0c7d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9486e7-8508-4fcf-a890-cbb94af7ec6c]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f35604-6515-44c0-b28d-b0a7bd113221]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fa2610-84db-4595-a602-533f7059a044]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260]
Aug 16 15:14:31 user nova-compute[73091]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca43731d-2505-454a-b605-30424280bfa5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== disconnect_volume: return (293ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'flavor' on Instance uuid 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-10e04edb-15ec-48dd-b0aa-1773b22ea1d0 tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.503s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:32 user nova-compute[73091]: INFO nova.compute.manager [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Terminating instance
Aug 16 15:14:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b34e0b64-4a0a-427d-9da2-1dc06f2fcadd req-a8aecd78-db34-42a1-93ef-b436109bb9a6 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-vif-unplugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b34e0b64-4a0a-427d-9da2-1dc06f2fcadd req-a8aecd78-db34-42a1-93ef-b436109bb9a6 service nova] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b34e0b64-4a0a-427d-9da2-1dc06f2fcadd req-a8aecd78-db34-42a1-93ef-b436109bb9a6 service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b34e0b64-4a0a-427d-9da2-1dc06f2fcadd req-a8aecd78-db34-42a1-93ef-b436109bb9a6 service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b34e0b64-4a0a-427d-9da2-1dc06f2fcadd req-a8aecd78-db34-42a1-93ef-b436109bb9a6 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] No waiting events found dispatching network-vif-unplugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-b34e0b64-4a0a-427d-9da2-1dc06f2fcadd req-a8aecd78-db34-42a1-93ef-b436109bb9a6 service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-vif-unplugged-64727212-d669-4510-b13d-3727fc797a2e for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Instance destroyed successfully.
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lazy-loading 'resources' on Instance uuid 9a040d49-3d4e-4496-b546-2daf1bf56978 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1328268220',display_name='tempest-VolumesSnapshotTestJSON-instance-1328268220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1328268220',id=28,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoEOLo+TUmg77EArTHK3Lf4XkFQQNMrSHeXAPt1fQKxGcAJSXlG8WRgkaP6iyNmkfRlW1MlaAHNd1u75IBWy3snrxQMFR/YB4KZJT41RHPRLGjnyZPs7LzuAswsp70fgw==',key_name='tempest-keypair-1043643829',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c654508f7acb4bc2b690668cfe19522d',ramdisk_id='',reservation_id='r-q53t0f1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-903677429',owner_user_name='tempest-VolumesSnapshotTestJSON-903677429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ba771d2c1c4164aac60e2f80ce7e77',uuid=9a040d49-3d4e-4496-b546-2daf1bf56978,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converting VIF {"id": "64727212-d669-4510-b13d-3727fc797a2e", "address": "fa:16:3e:10:80:eb", "network": {"id": "7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-351055173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c654508f7acb4bc2b690668cfe19522d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64727212-d6", "ovs_interfaceid": "64727212-d669-4510-b13d-3727fc797a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_vif [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64727212-d6, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:14:33 user nova-compute[73091]: INFO os_vif [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:80:eb,bridge_name='br-int',has_traffic_filtering=True,id=64727212-d669-4510-b13d-3727fc797a2e,network=Network(7b4d376b-d5f5-48b5-ab3b-b460c0dbfd86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64727212-d6')
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCHLxIyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:476ae106-e604-41a5-a5bd-6dd36e7e1073', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8030a2d-f4ae-44e3-b30f-a215763568c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7184e74-b9af-4251-8519-e6996c40a7bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11542d5990>, {}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] <== disconnect_volume: return (61ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:14:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Deleting instance files /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978_del
Aug 16 15:14:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Deletion of /opt/stack/data/nova/instances/9a040d49-3d4e-4496-b546-2daf1bf56978_del complete
Aug 16 15:14:33 user nova-compute[73091]: INFO nova.compute.manager [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 15:14:33 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:14:33 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Took 0.79 seconds to deallocate network for instance.
Aug 16 15:14:34 user nova-compute[73091]: WARNING nova.volume.cinder [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Attachment 3b49e1b4-2e17-4cf0-80c8-f442cffdf09c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3b49e1b4-2e17-4cf0-80c8-f442cffdf09c. (HTTP 404) (Request-ID: req-c4ec71f4-baca-415e-964d-837e28c1e191)
Aug 16 15:14:34 user nova-compute[73091]: INFO nova.compute.manager [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Took 0.07 seconds to detach 1 volumes for instance.
Aug 16 15:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] Acquiring lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] No waiting events found dispatching network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:34 user nova-compute[73091]: WARNING nova.compute.manager [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received unexpected event network-vif-plugged-64727212-d669-4510-b13d-3727fc797a2e for instance with vm_state deleted and task_state None.
Aug 16 15:14:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c17cb88-1e17-4670-8b07-41a5867e9aa8 req-4e08d560-ac9a-4e8a-be5d-00a21383f97c service nova] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Received event network-vif-deleted-64727212-d669-4510-b13d-3727fc797a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:34 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Deleted allocations for instance 9a040d49-3d4e-4496-b546-2daf1bf56978
Aug 16 15:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-18069081-2274-4481-b4d9-f9a0b63f7c1c tempest-VolumesSnapshotTestJSON-903677429 tempest-VolumesSnapshotTestJSON-903677429-project-member] Lock "9a040d49-3d4e-4496-b546-2daf1bf56978" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.525s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Port f94a19b5-a285-4efb-9931-8f26831a7382 binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Creating tmpfile /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/tmpb6ozxh3m to verify with other compute node that the instance is on the same shared storage. {{(pid=73091) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-74ce373d-363d-44b8-94da-2d5ce7e4259e req-d8080c71-2858-4dd4-9fb3-cdbb336c5986 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74ce373d-363d-44b8-94da-2d5ce7e4259e req-d8080c71-2858-4dd4-9fb3-cdbb336c5986 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74ce373d-363d-44b8-94da-2d5ce7e4259e req-d8080c71-2858-4dd4-9fb3-cdbb336c5986 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74ce373d-363d-44b8-94da-2d5ce7e4259e req-d8080c71-2858-4dd4-9fb3-cdbb336c5986 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-74ce373d-363d-44b8-94da-2d5ce7e4259e req-d8080c71-2858-4dd4-9fb3-cdbb336c5986 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:40 user nova-compute[73091]: WARNING nova.compute.manager [req-74ce373d-363d-44b8-94da-2d5ce7e4259e req-d8080c71-2858-4dd4-9fb3-cdbb336c5986 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state resized and task_state resize_reverting.
Aug 16 15:14:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance destroyed successfully.
Aug 16 15:14:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'resources' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf94a19b5-a2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:41 user nova-compute[73091]: INFO os_vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2')
Aug 16 15:14:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f8eaa4-64c4-4a3a-b188-e32953e71b22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd73e66-96cf-4ff2-9c59-c35d17d54b95]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c4a76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f61fe-7fcb-47d6-8edf-68862aa34fb6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcea1af-d4ec-4e54-b1d2-fe3bf8b5e7e1]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[867723e9-503f-4bb9-8d2e-35f7e03fbe90]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf1756-3b09-403e-88c4-4627b32645e9]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce6043-dd51-4e8f-95ab-cce6f6771f64]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[038dcc85-48c2-4f0c-9ccd-3e44cefae324]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]
Aug 16 15:14:41 user nova-compute[73091]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2189623d-4a2c-4dd3-ab3f-b0bcd139fe73]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== disconnect_volume: return (301ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'migration_context' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-98fa48bb-e0eb-4624-9658-4cc023a38441 req-f317f9d1-f22a-4796-a668-c1acd0d50a88 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98fa48bb-e0eb-4624-9658-4cc023a38441 req-f317f9d1-f22a-4796-a668-c1acd0d50a88 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98fa48bb-e0eb-4624-9658-4cc023a38441 req-f317f9d1-f22a-4796-a668-c1acd0d50a88 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98fa48bb-e0eb-4624-9658-4cc023a38441 req-f317f9d1-f22a-4796-a668-c1acd0d50a88 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-98fa48bb-e0eb-4624-9658-4cc023a38441 req-f317f9d1-f22a-4796-a668-c1acd0d50a88 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:42 user nova-compute[73091]: WARNING nova.compute.manager [req-98fa48bb-e0eb-4624-9658-4cc023a38441 req-f317f9d1-f22a-4796-a668-c1acd0d50a88 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state resized and task_state resize_reverting.
Aug 16 15:14:43 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.538s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:43 user nova-compute[73091]: INFO nova.compute.manager [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Swapping old allocation on dict_keys(['de22140b-6a80-4bc1-99c6-0964e3f024fc']) held by migration 8eeed9e0-7279-4457-bbe1-a07ba36f462f for instance
Aug 16 15:14:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Overwriting current allocation {'allocations': {'de22140b-6a80-4bc1-99c6-0964e3f024fc': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 40}}, 'project_id': 'ca74df5f6c3643879a985989a478d33a', 'user_id': '74c79b9ea11c4d108e57a04ed7052cd4', 'consumer_generation': 1} on consumer a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquired lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Releasing lock "refresh_cache-a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad477e-b495-4ff3-8e17-11bea22de8dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9478f-2bc9-46e2-aeb5-09ead8973db2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbb4e4d-5604-460f-8f59-4bfeb8adf00a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9e9efe-017c-43f8-a222-9b29ee047cd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:14:44 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:14:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1709a57-6e83-4afa-8a06-8a54067e8ef5]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:14:44 user nova-compute[73091]: DEBUG os_brick.utils [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing instance network info cache due to event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:14:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updated VIF entry in instance network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea1bd54f-f2bc-4a1a-8674-05a024705fc7 req-84c98e0b-35d5-4047-9d5e-7cd2bd4c42d6 service nova] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:46 user nova-compute[73091]: INFO nova.compute.manager [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Detaching volume 04b12214-8d09-49c4-be7f-def27f1e3e67
Aug 16 15:14:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:46 user nova-compute[73091]: INFO nova.virt.block_device [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Attempting to driver detach volume 04b12214-8d09-49c4-be7f-def27f1e3e67 from mountpoint /dev/vdb
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Attempting to detach device vdb from instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:14:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:46 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:14:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:46 user nova-compute[73091]:   <serial>04b12214-8d09-49c4-be7f-def27f1e3e67</serial>
Aug 16 15:14:46 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:14:46 user nova-compute[73091]: </disk>
Aug 16 15:14:46 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:14:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully detached device vdb from instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f from the persistent domain config.
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:14:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:46 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:14:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:14:46 user nova-compute[73091]:   <serial>04b12214-8d09-49c4-be7f-def27f1e3e67</serial>
Aug 16 15:14:46 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:14:46 user nova-compute[73091]: </disk>
Aug 16 15:14:46 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198886.9517162, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:14:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully detached device vdb from instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f from the live domain config.
Aug 16 15:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moIkDOJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f793b113-cf57-4f71-b414-be248d8dd0f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fbbb4-44f5-4004-b525-bd6b6a372273]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:47 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c578d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d51b6fd-00ed-4045-b6a2-aa3c015db824]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3382a9-44d2-4000-9327-4da337920231]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[700d2d72-60b5-4904-a48e-fc6aba7beef2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[265527e1-de73-47f9-8bad-6ceaaaeee6af]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd8a152-f800-4015-ba07-49bc6808f9f1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d334c5-af74-4889-9835-95f9e028a72d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260]
Aug 16 15:14:47 user nova-compute[73091]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b12214-8d09-49c4-be7f-def27f1e3e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[87062d86-0404-4aa5-b229-ae4d362b9133]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] <== disconnect_volume: return (320ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'flavor' on Instance uuid 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:47 user nova-compute[73091]: INFO nova.compute.manager [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Attaching volume 96f888fa-04f5-45a9-a792-f0d6e3c02b3c to /dev/vdb
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.utils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[377bdeaf-38f1-4dc3-83ab-a5a4ba8298a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c7794e-4c32-423b-bb94-d689aabbda5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce352e-ffa7-4189-a3f8-da66f369003e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5dcd90-2e55-4bc5-bdd0-021809092e88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:14:47 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecacae4-2b16-4428-b11e-e0fa7b6ba31d]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG os_brick.utils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updating existing volume attachment record: 1a9d1977-4aa2-4095-9d92-b5fa64d49285 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing instance network info cache due to event network-changed-d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] Acquiring lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] Acquired lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Refreshing network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:14:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'flavor' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aa2d10de-144a-4211-a256-2c9444214be4 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updated VIF entry in instance network info cache for port d6c4e4b6-5546-4221-8ec4-67a554f5c00d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [{"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] Releasing lock "refresh_cache-86f25d04-d425-4fcb-b502-f9d0ddee8b6f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-changed-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Refreshing instance network info cache due to event network-changed-3f1e4bec-a4fc-4b6b-a849-57156d17ceed. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] Acquiring lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] Acquired lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Refreshing network info cache for port 3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198873.2670348, 9a040d49-3d4e-4496-b546-2daf1bf56978 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:14:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] VM Stopped (Lifecycle Event)
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ee5ad567-4f64-48bb-a83e-424ba4dbd039 None None] [instance: 9a040d49-3d4e-4496-b546-2daf1bf56978] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updated VIF entry in instance network info cache for port 3f1e4bec-a4fc-4b6b-a849-57156d17ceed. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updating instance_info_cache with network_info: [{"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f0e5e73-6bab-45a2-b1a0-1d7ec2cb6a90 req-50b794b3-ffe0-46cb-9c5d-010505f1a456 service nova] Releasing lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:14:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Starting finish_revert_migration {{(pid=73091) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start _get_guest_xml network_info=[{"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '6d5a60a5-9e8f-421e-b825-99f6a44e7749', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a42f48f4-9a4e-4b6f-b61c-59b8ba7de752', 'attached_at': '2023-08-16T15:14:55.000000', 'detached_at': '', 'volume_id': 'bf6502f7-b3a5-4ada-9afe-2c2762bf3e67', 'serial': 'bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:14:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:14:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'vcpu_model' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:14:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:14:55 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c50221-5b61-43de-be93-30e1554fe9ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:14:55 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea9c0b-1917-4208-abea-0fe41c101463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67] added
Aug 16 15:14:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ba7b00-3a52-4d33-9af3-3f99e8878711]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d37fca-881b-47ea-9072-aab635a54421]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrhAYaNQ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrhAYaNQ" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[640ad72c-3eb5-4d5d-991a-5580915fa0a5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrhAYaNQ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d7b78-7ac3-4942-adb6-8890811f42a5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2248de96-8c1f-4850-833f-ca40ac1b203d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a2160-6b9c-45f3-a102-83991cca0ca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]
Aug 16 15:14:55 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:14:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f70d44-2125-490f-8a9d-28e27a9dcb85]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a4d1d8-fe0d-44cc-9478-aee06025b6f0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:14:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43f7f74-d144-44d5-8084-0e2c812a34a9]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:14:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198881.3498082, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:14:56 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Stopped (Lifecycle Event)
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-879b1dcf-e1d3-4e4a-9d04-b32e0748b0d1 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26639626531333064', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639626531333064', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:14:56 user nova-compute[73091]:   <uuid>a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</uuid>
Aug 16 15:14:56 user nova-compute[73091]:   <name>instance-00000017</name>
Aug 16 15:14:56 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:14:56 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:14:56 user nova-compute[73091]:   <metadata>
Aug 16 15:14:56 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:14:56 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:14:56 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-511399511</nova:name>
Aug 16 15:14:56 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:14:55</nova:creationTime>
Aug 16 15:14:56 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:14:56 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:14:56 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:14:56 user nova-compute[73091]:       <nova:owner>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:user uuid="74c79b9ea11c4d108e57a04ed7052cd4">tempest-ServerActionsTestOtherB-2002245511-project-member</nova:user>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:project uuid="ca74df5f6c3643879a985989a478d33a">tempest-ServerActionsTestOtherB-2002245511</nova:project>
Aug 16 15:14:56 user nova-compute[73091]:       </nova:owner>
Aug 16 15:14:56 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:14:56 user nova-compute[73091]:       <nova:ports>
Aug 16 15:14:56 user nova-compute[73091]:         <nova:port uuid="f94a19b5-a285-4efb-9931-8f26831a7382">
Aug 16 15:14:56 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:14:56 user nova-compute[73091]:         </nova:port>
Aug 16 15:14:56 user nova-compute[73091]:       </nova:ports>
Aug 16 15:14:56 user nova-compute[73091]:     </nova:instance>
Aug 16 15:14:56 user nova-compute[73091]:   </metadata>
Aug 16 15:14:56 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:14:56 user nova-compute[73091]:     <system>
Aug 16 15:14:56 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:14:56 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:14:56 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:14:56 user nova-compute[73091]:       <entry name="serial">a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</entry>
Aug 16 15:14:56 user nova-compute[73091]:       <entry name="uuid">a42f48f4-9a4e-4b6f-b61c-59b8ba7de752</entry>
Aug 16 15:14:56 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:14:56 user nova-compute[73091]:     </system>
Aug 16 15:14:56 user nova-compute[73091]:   </sysinfo>
Aug 16 15:14:56 user nova-compute[73091]:   <os>
Aug 16 15:14:56 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:14:56 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:14:56 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:14:56 user nova-compute[73091]:   </os>
Aug 16 15:14:56 user nova-compute[73091]:   <features>
Aug 16 15:14:56 user nova-compute[73091]:     <acpi/>
Aug 16 15:14:56 user nova-compute[73091]:     <apic/>
Aug 16 15:14:56 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:14:56 user nova-compute[73091]:   </features>
Aug 16 15:14:56 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:14:56 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:14:56 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:14:56 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:14:56 user nova-compute[73091]:   </clock>
Aug 16 15:14:56 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:14:56 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:14:56 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:14:56 user nova-compute[73091]:   </cpu>
Aug 16 15:14:56 user nova-compute[73091]:   <devices>
Aug 16 15:14:56 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:14:56 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:14:56 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk"/>
Aug 16 15:14:56 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:14:56 user nova-compute[73091]:     </disk>
Aug 16 15:14:56 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:14:56 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:14:56 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 15:14:56 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:14:56 user nova-compute[73091]:       <serial>bf6502f7-b3a5-4ada-9afe-2c2762bf3e67</serial>
Aug 16 15:14:56 user nova-compute[73091]:     </disk>
Aug 16 15:14:56 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:14:56 user nova-compute[73091]:       <mac address="fa:16:3e:05:9f:63"/>
Aug 16 15:14:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:14:56 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:14:56 user nova-compute[73091]:       <target dev="tapf94a19b5-a2"/>
Aug 16 15:14:56 user nova-compute[73091]:     </interface>
Aug 16 15:14:56 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:14:56 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/console.log" append="off"/>
Aug 16 15:14:56 user nova-compute[73091]:     </serial>
Aug 16 15:14:56 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:14:56 user nova-compute[73091]:     <video>
Aug 16 15:14:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:14:56 user nova-compute[73091]:     </video>
Aug 16 15:14:56 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:14:56 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:14:56 user nova-compute[73091]:     </rng>
Aug 16 15:14:56 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:14:56 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:14:56 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:14:56 user nova-compute[73091]:     </memballoon>
Aug 16 15:14:56 user nova-compute[73091]:   </devices>
Aug 16 15:14:56 user nova-compute[73091]: </domain>
Aug 16 15:14:56 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG os_vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf94a19b5-a2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf94a19b5-a2, col_values=(('external_ids', {'iface-id': 'f94a19b5-a285-4efb-9931-8f26831a7382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9f:63', 'vm-uuid': 'a42f48f4-9a4e-4b6f-b61c-59b8ba7de752'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:14:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:56 user nova-compute[73091]: INFO os_vif [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2')
Aug 16 15:14:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4b25b5b-1c3f-4c14-bb1b-e4d223386dec req-10150d55-0159-48f2-9385-b77aeaa2a9dc service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4b25b5b-1c3f-4c14-bb1b-e4d223386dec req-10150d55-0159-48f2-9385-b77aeaa2a9dc service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4b25b5b-1c3f-4c14-bb1b-e4d223386dec req-10150d55-0159-48f2-9385-b77aeaa2a9dc service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4b25b5b-1c3f-4c14-bb1b-e4d223386dec req-10150d55-0159-48f2-9385-b77aeaa2a9dc service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4b25b5b-1c3f-4c14-bb1b-e4d223386dec req-10150d55-0159-48f2-9385-b77aeaa2a9dc service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:14:58 user nova-compute[73091]: WARNING nova.compute.manager [req-c4b25b5b-1c3f-4c14-bb1b-e4d223386dec req-10150d55-0159-48f2-9385-b77aeaa2a9dc service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state resized and task_state resize_reverting.
Aug 16 15:14:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:14:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198900.2095456, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Resumed (Lifecycle Event)
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance running successfully.
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] finish_revert_migration finished successfully. {{(pid=73091) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-43ed76f0-7af0-43eb-b1c1-8c31e44bb75d req-d6250ff3-d668-43f9-989e-e7a5c0bcead5 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43ed76f0-7af0-43eb-b1c1-8c31e44bb75d req-d6250ff3-d668-43f9-989e-e7a5c0bcead5 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43ed76f0-7af0-43eb-b1c1-8c31e44bb75d req-d6250ff3-d668-43f9-989e-e7a5c0bcead5 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43ed76f0-7af0-43eb-b1c1-8c31e44bb75d req-d6250ff3-d668-43f9-989e-e7a5c0bcead5 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-43ed76f0-7af0-43eb-b1c1-8c31e44bb75d req-d6250ff3-d668-43f9-989e-e7a5c0bcead5 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:00 user nova-compute[73091]: WARNING nova.compute.manager [req-43ed76f0-7af0-43eb-b1c1-8c31e44bb75d req-d6250ff3-d668-43f9-989e-e7a5c0bcead5 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state resized and task_state resize_reverting.
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198900.2110443, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Started (Lifecycle Event)
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.compute.manager [None req-f0384f42-43f1-46a5-a7f5-6357ba008049 tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance to original state: 'active'
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:00 user nova-compute[73091]: INFO nova.compute.manager [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Terminating instance
Aug 16 15:15:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6b5c9491-a468-4487-8f43-ddbf2903b62c req-a971b1dd-bc8b-4705-b37b-3b7455ea17a6 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-unplugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6b5c9491-a468-4487-8f43-ddbf2903b62c req-a971b1dd-bc8b-4705-b37b-3b7455ea17a6 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6b5c9491-a468-4487-8f43-ddbf2903b62c req-a971b1dd-bc8b-4705-b37b-3b7455ea17a6 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6b5c9491-a468-4487-8f43-ddbf2903b62c req-a971b1dd-bc8b-4705-b37b-3b7455ea17a6 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6b5c9491-a468-4487-8f43-ddbf2903b62c req-a971b1dd-bc8b-4705-b37b-3b7455ea17a6 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-unplugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6b5c9491-a468-4487-8f43-ddbf2903b62c req-a971b1dd-bc8b-4705-b37b-3b7455ea17a6 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-unplugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Instance destroyed successfully.
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lazy-loading 'resources' on Instance uuid 0501f6bc-55a5-4112-9036-1f05880cdd8b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1236672584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1236672',id=29,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz4ZyjqrcrKXviakhHI5Y8o0ntt7kMW269B4axQgXI20UOmnEX+IOw4zlB/V23EqWEW0/WaexnwBaqwKg4R5l0qMW5LMIJdeKKIc9G9AZ1K6olL0iU3DG4jTEz5YGlbpg==',key_name='tempest-keypair-983592156',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52a7f88e03d645cba7080becd3f2ca41',ramdisk_id='',reservation_id='r-28k4ckmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-252025234',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2d62bdb5214893859265efcf7daaea',uuid=0501f6bc-55a5-4112-9036-1f05880cdd8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Converting VIF {"id": "f545ab0e-caf2-473a-9102-c541e4b40bda", "address": "fa:16:3e:fc:10:b8", "network": {"id": "9d781582-9d54-4a4b-921a-886555afaf61", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1636644952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52a7f88e03d645cba7080becd3f2ca41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf545ab0e-ca", "ovs_interfaceid": "f545ab0e-caf2-473a-9102-c541e4b40bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG os_vif [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf545ab0e-ca, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:15:01 user nova-compute[73091]: INFO os_vif [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:10:b8,bridge_name='br-int',has_traffic_filtering=True,id=f545ab0e-caf2-473a-9102-c541e4b40bda,network=Network(9d781582-9d54-4a4b-921a-886555afaf61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf545ab0e-ca')
Aug 16 15:15:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Deleting instance files /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b_del
Aug 16 15:15:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Deletion of /opt/stack/data/nova/instances/0501f6bc-55a5-4112-9036-1f05880cdd8b_del complete
Aug 16 15:15:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:01 user nova-compute[73091]: INFO nova.compute.manager [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 15:15:01 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:15:01 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Took 1.15 seconds to deallocate network for instance.
Aug 16 15:15:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-30398b53-22da-471a-b48e-dfba0457f0ff req-edf9cb34-b1a0-48ff-8081-ff3fd552e495 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-deleted-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:02 user nova-compute[73091]: INFO nova.compute.manager [req-30398b53-22da-471a-b48e-dfba0457f0ff req-edf9cb34-b1a0-48ff-8081-ff3fd552e495 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Neutron deleted interface f545ab0e-caf2-473a-9102-c541e4b40bda; detaching it from the instance and deleting it from the info cache
Aug 16 15:15:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-30398b53-22da-471a-b48e-dfba0457f0ff req-edf9cb34-b1a0-48ff-8081-ff3fd552e495 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-30398b53-22da-471a-b48e-dfba0457f0ff req-edf9cb34-b1a0-48ff-8081-ff3fd552e495 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Detach interface failed, port_id=f545ab0e-caf2-473a-9102-c541e4b40bda, reason: Instance 0501f6bc-55a5-4112-9036-1f05880cdd8b could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:03 user nova-compute[73091]: WARNING nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state deleted and task_state None.
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:03 user nova-compute[73091]: WARNING nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state deleted and task_state None.
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:03 user nova-compute[73091]: WARNING nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state deleted and task_state None.
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-unplugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-unplugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:03 user nova-compute[73091]: WARNING nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-unplugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state deleted and task_state None.
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Acquiring lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] No waiting events found dispatching network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:03 user nova-compute[73091]: WARNING nova.compute.manager [req-3b5291b6-5ceb-4c03-a443-696413207444 req-1a93407b-3d6a-443d-a838-d8352f85f951 service nova] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Received unexpected event network-vif-plugged-f545ab0e-caf2-473a-9102-c541e4b40bda for instance with vm_state deleted and task_state None.
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Deleted allocations for instance 0501f6bc-55a5-4112-9036-1f05880cdd8b
Aug 16 15:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-343b757c-2d12-42d3-a55d-f7700a06db78 tempest-TestServerVolumeAttachScenarioOldVersion-252025234 tempest-TestServerVolumeAttachScenarioOldVersion-252025234-project-member] Lock "0501f6bc-55a5-4112-9036-1f05880cdd8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYwHoEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:15:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:15:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:15:06 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f24c1-2bec-4e4a-910e-c689701ad042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:15:06 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1205f37f-6e51-48c1-9ddb-e7d70180d96a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c] added
Aug 16 15:15:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea91581-d46a-4a14-aa6f-066576f80894]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4966f59-cf3e-4c38-ae86-568fcfd33c0d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycYwHoEf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycYwHoEf" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc18730-6b72-479e-8b20-6ecf16963112]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycYwHoEf'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae4a6d-05af-43c6-8b52-e61c25aeb6af]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ca3712-6aad-4751-8928-7064af3539f2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4928d1da-2add-4135-b490-06e13ba50725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260]
Aug 16 15:15:06 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260] successful.
Aug 16 15:15:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764ae1b-c657-49c6-8c5a-918e479e9399]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b9719-d551-4407-ba84-9b02980a2ef8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c (non-flash)
Aug 16 15:15:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:06 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c (non-flash)
Aug 16 15:15:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a29535-a88b-40a6-a2bf-d69af2eec48d]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYwHoEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23461616632666130', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461616632666130', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'flavor' on Instance uuid 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:15:07 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:15:07 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:15:07 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:15:07 user nova-compute[73091]:   <serial>96f888fa-04f5-45a9-a792-f0d6e3c02b3c</serial>
Aug 16 15:15:07 user nova-compute[73091]: </disk>
Aug 16 15:15:07 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] No VIF found with MAC fa:16:3e:65:d8:7b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-668118c0-a5b7-41b8-bffa-223ccad236b6 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.643s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:10 user nova-compute[73091]: INFO nova.compute.manager [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Detaching volume 96f888fa-04f5-45a9-a792-f0d6e3c02b3c
Aug 16 15:15:10 user nova-compute[73091]: INFO nova.virt.block_device [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Attempting to driver detach volume 96f888fa-04f5-45a9-a792-f0d6e3c02b3c from mountpoint /dev/vdb
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Attempting to detach device vdb from instance 7b091903-0cb2-4e1e-9df9-a7570facb46e from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:15:10 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:15:10 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:15:10 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:15:10 user nova-compute[73091]:   <serial>96f888fa-04f5-45a9-a792-f0d6e3c02b3c</serial>
Aug 16 15:15:10 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:15:10 user nova-compute[73091]: </disk>
Aug 16 15:15:10 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:15:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully detached device vdb from instance 7b091903-0cb2-4e1e-9df9-a7570facb46e from the persistent domain config.
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b091903-0cb2-4e1e-9df9-a7570facb46e from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:15:10 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:15:10 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 15:15:10 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:15:10 user nova-compute[73091]:   <serial>96f888fa-04f5-45a9-a792-f0d6e3c02b3c</serial>
Aug 16 15:15:10 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:15:10 user nova-compute[73091]: </disk>
Aug 16 15:15:10 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198910.8995333, 7b091903-0cb2-4e1e-9df9-a7570facb46e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:15:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully detached device vdb from instance 7b091903-0cb2-4e1e-9df9-a7570facb46e from the live domain config.
Aug 16 15:15:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYwHoEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:15:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f42e97-c34d-4acf-85e8-c0409aa7f6a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5061d6-b80c-45a6-b1eb-9f11f71cffbf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c (non-flash)
Aug 16 15:15:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:10 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c (non-flash)
Aug 16 15:15:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c533d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:15:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acffb60-c31e-4813-a607-03689d775f82]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2918ed8e-7be5-4bef-ae19-342f8c1b213e]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7921e208-3840-44be-ad3d-ec0dae2c4539]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f93338-f20e-4023-8680-615f19154842]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28616915-8107-43f3-8b6d-c9dc9e3d7dee]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a121de-eaaf-43a9-afde-cec2114ac232]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260]
Aug 16 15:15:11 user nova-compute[73091]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c, portal: 172.16.0.220,3260] successful.
Aug 16 15:15:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96f888fa-04f5-45a9-a792-f0d6e3c02b3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf6f59-78ce-43a2-9421-70c1e7303ac9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] <== disconnect_volume: return (329ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'flavor' on Instance uuid 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1af52fe1-6b03-4f5e-9514-0f210db3fe9e tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.805s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:15:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=6927MB free_disk=24.992618560791016GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Applying migration context for instance 8e6d2c04-e78d-439f-8259-e3fae71840ba as it has an incoming, in-progress migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f. Migration status is finished {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 15:15:13 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating resource usage from migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7d8df62-ad41-488e-9612-287fee103229 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7b091903-0cb2-4e1e-9df9-a7570facb46e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e1867285-e33a-4b24-8f9e-96886a018a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:15:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198901.4196715, 0501f6bc-55a5-4112-9036-1f05880cdd8b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:15:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] VM Stopped (Lifecycle Event)
Aug 16 15:15:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf973b25-4eae-49ce-b8e9-8f6cd50a832a None None] [instance: 0501f6bc-55a5-4112-9036-1f05880cdd8b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing instance network info cache due to event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:15:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [{"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-9498b706-c5d2-4ba8-9d94-bc335fbdca2b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updated VIF entry in instance network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b3e0925-ab75-445e-b907-2dae1f616520 req-ff3be458-86c8-4aab-86c4-5719cd95b09a service nova] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing instance network info cache due to event network-changed-56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] Acquiring lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] Acquired lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Refreshing network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:19 user nova-compute[73091]: INFO nova.compute.manager [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Detaching volume 5b38c794-c8e4-4755-b10d-b8269908ee50
Aug 16 15:15:19 user nova-compute[73091]: INFO nova.virt.block_device [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Attempting to driver detach volume 5b38c794-c8e4-4755-b10d-b8269908ee50 from mountpoint /dev/vdb
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Attempting to detach device vdb from instance b7d8df62-ad41-488e-9612-287fee103229 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:15:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:15:19 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:15:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:15:19 user nova-compute[73091]:   <serial>5b38c794-c8e4-4755-b10d-b8269908ee50</serial>
Aug 16 15:15:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:15:19 user nova-compute[73091]: </disk>
Aug 16 15:15:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:15:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully detached device vdb from instance b7d8df62-ad41-488e-9612-287fee103229 from the persistent domain config.
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7d8df62-ad41-488e-9612-287fee103229 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:15:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:15:19 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:15:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:15:19 user nova-compute[73091]:   <serial>5b38c794-c8e4-4755-b10d-b8269908ee50</serial>
Aug 16 15:15:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:15:19 user nova-compute[73091]: </disk>
Aug 16 15:15:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692198919.7052026, b7d8df62-ad41-488e-9612-287fee103229 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:15:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully detached device vdb from instance b7d8df62-ad41-488e-9612-287fee103229 from the live domain config.
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioXvbwtl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:15:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e806f-a534-4a05-a877-b21c40eb69b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updated VIF entry in instance network info cache for port 56ae74d8-0d8d-4492-80a2-174d2c2d85f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [{"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f005da-f0b7-4edf-a721-499aae68b5c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:15:19 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:15:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c524ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-809bb8e7-0ad4-491e-a345-680517cc169a req-4f17c55f-19c5-4fee-a667-d71a47d4f0ff service nova] Releasing lock "refresh_cache-b7d8df62-ad41-488e-9612-287fee103229" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[589b01b7-7c37-4d35-97e8-05903a8de43a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[86996ff6-aea7-41ae-bcd4-093761161b07]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe70c4f-4103-4a44-80aa-7a4b832d242e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad30d38a-2887-4e1a-a101-8319a308fe3b]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab9d32-5c04-4501-9bd2-82a8b713ecc1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd62431-ef7a-4364-9b37-39a93cb77318]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260]
Aug 16 15:15:19 user nova-compute[73091]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50, portal: 172.16.0.220,3260] successful.
Aug 16 15:15:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b38c794-c8e4-4755-b10d-b8269908ee50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[da784a2f-9a6f-4d74-abea-0b028e2b9c68]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== disconnect_volume: return (296ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'flavor' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-582c2323-fa61-4200-a0d8-ddb587fcad2d tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:15:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:15:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:30 user nova-compute[73091]: INFO nova.compute.manager [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Unrescuing
Aug 16 15:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquired lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:15:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updating instance_info_cache with network_info: [{"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Releasing lock "refresh_cache-c6017245-2e44-4fd0-9760-2b8f2e9f6df2" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'flavor' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-d3cdd535-62b1-4355-abf6-ccacd8f85c8b req-1298a082-542c-4aed-acd4-b99b149cc152 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d3cdd535-62b1-4355-abf6-ccacd8f85c8b req-1298a082-542c-4aed-acd4-b99b149cc152 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d3cdd535-62b1-4355-abf6-ccacd8f85c8b req-1298a082-542c-4aed-acd4-b99b149cc152 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d3cdd535-62b1-4355-abf6-ccacd8f85c8b req-1298a082-542c-4aed-acd4-b99b149cc152 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-d3cdd535-62b1-4355-abf6-ccacd8f85c8b req-1298a082-542c-4aed-acd4-b99b149cc152 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:31 user nova-compute[73091]: WARNING nova.compute.manager [req-d3cdd535-62b1-4355-abf6-ccacd8f85c8b req-1298a082-542c-4aed-acd4-b99b149cc152 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:15:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance destroyed successfully.
Aug 16 15:15:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:33 user nova-compute[73091]: WARNING nova.compute.manager [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:15:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:33 user nova-compute[73091]: WARNING nova.compute.manager [req-2aad756d-b94c-40bd-9091-150937fe8698 req-a0f2eda1-ef97-43c3-bff6-c767873bd7d2 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for c6017245-2e44-4fd0-9760-2b8f2e9f6df2 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198935.0677764, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:15:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Resumed (Lifecycle Event)
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d87ef43d-09b4-47cb-9e23-ac10ab83bcbc tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:15:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692198935.0728207, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:15:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Started (Lifecycle Event)
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-49f39a79-a6ae-4a8a-baa9-5fe8e69e73ee req-cc734d89-0239-4488-a083-153167092eab service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49f39a79-a6ae-4a8a-baa9-5fe8e69e73ee req-cc734d89-0239-4488-a083-153167092eab service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49f39a79-a6ae-4a8a-baa9-5fe8e69e73ee req-cc734d89-0239-4488-a083-153167092eab service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49f39a79-a6ae-4a8a-baa9-5fe8e69e73ee req-cc734d89-0239-4488-a083-153167092eab service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-49f39a79-a6ae-4a8a-baa9-5fe8e69e73ee req-cc734d89-0239-4488-a083-153167092eab service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:35 user nova-compute[73091]: WARNING nova.compute.manager [req-49f39a79-a6ae-4a8a-baa9-5fe8e69e73ee req-cc734d89-0239-4488-a083-153167092eab service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state active and task_state None.
Aug 16 15:15:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:36 user nova-compute[73091]: INFO nova.compute.manager [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Terminating instance
Aug 16 15:15:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c6df7570-d797-4ba6-8942-461d295d19a4 req-d0e7012c-6313-41a8-be00-05e48cb8e26f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c6df7570-d797-4ba6-8942-461d295d19a4 req-d0e7012c-6313-41a8-be00-05e48cb8e26f service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c6df7570-d797-4ba6-8942-461d295d19a4 req-d0e7012c-6313-41a8-be00-05e48cb8e26f service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c6df7570-d797-4ba6-8942-461d295d19a4 req-d0e7012c-6313-41a8-be00-05e48cb8e26f service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c6df7570-d797-4ba6-8942-461d295d19a4 req-d0e7012c-6313-41a8-be00-05e48cb8e26f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c6df7570-d797-4ba6-8942-461d295d19a4 req-d0e7012c-6313-41a8-be00-05e48cb8e26f service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-unplugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Instance destroyed successfully.
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'resources' on Instance uuid 86f25d04-d425-4fcb-b502-f9d0ddee8b6f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920729177',display_name='tempest-ServerRescueNegativeTestJSON-server-920729177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920729177',id=25,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFrlhy1Sn18rFziQLvR7ck0OWZ0Nn3+QEeu842U/5Tb41Xo+utkGsudC70oKMuV5erO3jTN73jNOYID0yIThT3L/ST2g1Hsf3ILwdV+oy4rBykFqhsETxawdFd9JZlxuQ==',key_name='tempest-keypair-1819551141',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-qt2chcaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=86f25d04-d425-4fcb-b502-f9d0ddee8b6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "address": "fa:16:3e:9d:35:5f", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c4e4b6-55", "ovs_interfaceid": "d6c4e4b6-5546-4221-8ec4-67a554f5c00d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG os_vif [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c4e4b6-55, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:37 user nova-compute[73091]: INFO os_vif [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:35:5f,bridge_name='br-int',has_traffic_filtering=True,id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c4e4b6-55')
Aug 16 15:15:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Deleting instance files /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f_del
Aug 16 15:15:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Deletion of /opt/stack/data/nova/instances/86f25d04-d425-4fcb-b502-f9d0ddee8b6f_del complete
Aug 16 15:15:37 user nova-compute[73091]: INFO nova.compute.manager [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 15:15:37 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:38 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:38 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Took 0.86 seconds to deallocate network for instance.
Aug 16 15:15:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-b88c196d-df8b-4b4d-a52e-fe2804f1db3c req-77ed1001-b459-461c-a167-a1b08189cc99 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-deleted-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:38 user nova-compute[73091]: INFO nova.compute.manager [req-b88c196d-df8b-4b4d-a52e-fe2804f1db3c req-77ed1001-b459-461c-a167-a1b08189cc99 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Neutron deleted interface d6c4e4b6-5546-4221-8ec4-67a554f5c00d; detaching it from the instance and deleting it from the info cache
Aug 16 15:15:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-b88c196d-df8b-4b4d-a52e-fe2804f1db3c req-77ed1001-b459-461c-a167-a1b08189cc99 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-b88c196d-df8b-4b4d-a52e-fe2804f1db3c req-77ed1001-b459-461c-a167-a1b08189cc99 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Detach interface failed, port_id=d6c4e4b6-5546-4221-8ec4-67a554f5c00d, reason: Instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:15:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:15:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:15:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:39 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Deleted allocations for instance 86f25d04-d425-4fcb-b502-f9d0ddee8b6f
Aug 16 15:15:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b4d1aa8-62d7-4b42-9846-bf540508a7e7 req-ad444937-bd1b-439e-bbfb-c3721a49f6a3 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b4d1aa8-62d7-4b42-9846-bf540508a7e7 req-ad444937-bd1b-439e-bbfb-c3721a49f6a3 service nova] Acquiring lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b4d1aa8-62d7-4b42-9846-bf540508a7e7 req-ad444937-bd1b-439e-bbfb-c3721a49f6a3 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b4d1aa8-62d7-4b42-9846-bf540508a7e7 req-ad444937-bd1b-439e-bbfb-c3721a49f6a3 service nova] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b4d1aa8-62d7-4b42-9846-bf540508a7e7 req-ad444937-bd1b-439e-bbfb-c3721a49f6a3 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] No waiting events found dispatching network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:39 user nova-compute[73091]: WARNING nova.compute.manager [req-5b4d1aa8-62d7-4b42-9846-bf540508a7e7 req-ad444937-bd1b-439e-bbfb-c3721a49f6a3 service nova] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Received unexpected event network-vif-plugged-d6c4e4b6-5546-4221-8ec4-67a554f5c00d for instance with vm_state deleted and task_state None.
Aug 16 15:15:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-840de1f5-6673-4cec-822e-443b1db2e794 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "86f25d04-d425-4fcb-b502-f9d0ddee8b6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing instance network info cache due to event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updated VIF entry in instance network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c81a29dd-3d13-4f4e-ae9a-9294bde60347 req-3b540986-c5aa-434f-ab12-ab06fc257be6 service nova] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:47 user nova-compute[73091]: INFO nova.compute.manager [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Shelving
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-baad4044-0537-456e-a6e2-f05287aa7581 req-c8c34295-a8a0-44a9-99f0-e67ee03e54d6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-baad4044-0537-456e-a6e2-f05287aa7581 req-c8c34295-a8a0-44a9-99f0-e67ee03e54d6 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-baad4044-0537-456e-a6e2-f05287aa7581 req-c8c34295-a8a0-44a9-99f0-e67ee03e54d6 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-baad4044-0537-456e-a6e2-f05287aa7581 req-c8c34295-a8a0-44a9-99f0-e67ee03e54d6 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-baad4044-0537-456e-a6e2-f05287aa7581 req-c8c34295-a8a0-44a9-99f0-e67ee03e54d6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:47 user nova-compute[73091]: WARNING nova.compute.manager [req-baad4044-0537-456e-a6e2-f05287aa7581 req-c8c34295-a8a0-44a9-99f0-e67ee03e54d6 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state active and task_state shelving.
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance destroyed successfully.
Aug 16 15:15:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Beginning cold snapshot process
Aug 16 15:15:48 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:15:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk /opt/stack/data/nova/instances/snapshots/tmp9k29j06y/81f6367425e64683a680533bccac57de {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:15:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk /opt/stack/data/nova/instances/snapshots/tmp9k29j06y/81f6367425e64683a680533bccac57de" returned: 0 in 0.624s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:15:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Snapshot extracted, beginning image upload
Aug 16 15:15:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-95c5ee47-b4dc-4f3e-b63d-9a3aadfe0aaa req-83cb9b43-38ee-4db1-9708-4efc160e8f47 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-95c5ee47-b4dc-4f3e-b63d-9a3aadfe0aaa req-83cb9b43-38ee-4db1-9708-4efc160e8f47 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-95c5ee47-b4dc-4f3e-b63d-9a3aadfe0aaa req-83cb9b43-38ee-4db1-9708-4efc160e8f47 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-95c5ee47-b4dc-4f3e-b63d-9a3aadfe0aaa req-83cb9b43-38ee-4db1-9708-4efc160e8f47 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-95c5ee47-b4dc-4f3e-b63d-9a3aadfe0aaa req-83cb9b43-38ee-4db1-9708-4efc160e8f47 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:15:49 user nova-compute[73091]: WARNING nova.compute.manager [req-95c5ee47-b4dc-4f3e-b63d-9a3aadfe0aaa req-83cb9b43-38ee-4db1-9708-4efc160e8f47 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 15:15:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Snapshot image upload complete
Aug 16 15:15:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:51 user nova-compute[73091]: INFO nova.compute.manager [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Shelve offloading
Aug 16 15:15:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance destroyed successfully.
Aug 16 15:15:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:15:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Going to confirm migration 2 {{(pid=73091) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198937.456725, 86f25d04-d425-4fcb-b502-f9d0ddee8b6f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:15:52 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] VM Stopped (Lifecycle Event)
Aug 16 15:15:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b404365b-98b7-408a-9b5c-4f582f9ef609 None None] [instance: 86f25d04-d425-4fcb-b502-f9d0ddee8b6f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquired lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'info_cache' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [{"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Releasing lock "refresh_cache-8e6d2c04-e78d-439f-8259-e3fae71840ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'migration_context' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:15:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance destroyed successfully.
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'resources' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937008942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937008942',id=33,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/DBgrLgwI4zaI4rWEC7+z1vkl35C8R5oYUvNcjwjH/UMTG020zjicREFf371y90owyPLCU9gC8skIVbMioQyFgHe1GnSQeADg1+pqGObzKo3NYGuX/1fl9pGFsZ7HAA==',key_name='tempest-keypair-1222551489',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-yytgy2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member',shelved_at='2023-08-16T15:15:51.324847',shelved_host='user',shelved_image_id='466348fe-c838-418a-b2ca-8fa2f091fe31'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=e1867285-e33a-4b24-8f9e-96886a018a90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG os_vif [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c487e54-2a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:15:53 user nova-compute[73091]: INFO os_vif [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a')
Aug 16 15:15:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Deleting instance files /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90_del
Aug 16 15:15:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Deletion of /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90_del complete
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing instance network info cache due to event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.544s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:53 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Deleted allocations for instance e1867285-e33a-4b24-8f9e-96886a018a90
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:15:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'numa_topology' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:15:54 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Deleted allocation for migration 4b52e1b3-e8ea-4533-ac9c-fc1ea9f8f50f
Aug 16 15:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd5d5ef7-912e-4d0c-a888-da23a34e3d6b tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.627s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f906a52-bccf-4538-bcf8-711fdfef441f tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.243s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updated VIF entry in instance network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7c487e54-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e968f88-1071-4f26-bc4a-8dcac91efdd3 req-14483147-a78f-4f7e-ab66-c385fed44e19 service nova] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:15:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:15:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-changed-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Refreshing instance network info cache due to event network-changed-3f1e4bec-a4fc-4b6b-a849-57156d17ceed. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] Acquiring lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] Acquired lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Refreshing network info cache for port 3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:01 user nova-compute[73091]: INFO nova.compute.manager [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Terminating instance
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-7abb7bc0-b3ab-461c-99f5-0d6766f8d899 req-3714b207-4065-4dc7-8cc4-a07975d65fe8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-vif-unplugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7abb7bc0-b3ab-461c-99f5-0d6766f8d899 req-3714b207-4065-4dc7-8cc4-a07975d65fe8 service nova] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7abb7bc0-b3ab-461c-99f5-0d6766f8d899 req-3714b207-4065-4dc7-8cc4-a07975d65fe8 service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7abb7bc0-b3ab-461c-99f5-0d6766f8d899 req-3714b207-4065-4dc7-8cc4-a07975d65fe8 service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-7abb7bc0-b3ab-461c-99f5-0d6766f8d899 req-3714b207-4065-4dc7-8cc4-a07975d65fe8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] No waiting events found dispatching network-vif-unplugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-7abb7bc0-b3ab-461c-99f5-0d6766f8d899 req-3714b207-4065-4dc7-8cc4-a07975d65fe8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-vif-unplugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updated VIF entry in instance network info cache for port 3f1e4bec-a4fc-4b6b-a849-57156d17ceed. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updating instance_info_cache with network_info: [{"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e3eb0759-15b5-4c63-833d-a02d72ca2e5e req-75c4e142-3f4f-4842-84ca-b5770729f2d8 service nova] Releasing lock "refresh_cache-7b091903-0cb2-4e1e-9df9-a7570facb46e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:16:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Instance destroyed successfully.
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'resources' on Instance uuid 7b091903-0cb2-4e1e-9df9-a7570facb46e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-528572090',display_name='tempest-TestStampPattern-server-528572090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-528572090',id=32,image_ref='d0b98536-c5c3-4e83-9b47-0904c59e2965',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyyAHLuiEqk4ejPwZhUcUKJyBqGOrb26zCZeDgHOg2VmzOCttHuqlkmEdCyFVOyQf9aIP2jNoS5d8k16YNuBnyk8HTbk6rg3OFMv70c4z0S2JbDt5MlYiurLWhEiKpxw==',key_name='tempest-TestStampPattern-728212450',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb0baba8e83d4fde9afda048ecd7b317',ramdisk_id='',reservation_id='r-p0tgvshw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fd4b79ad-6f00-41f3-addc-ada5aa1f84f6',image_min_disk='1',image_min_ram='0',image_owner_id='eb0baba8e83d4fde9afda048ecd7b317',image_owner_project_name='tempest-TestStampPattern-1880881768',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1880881768-project-member',image_user_id='f00f519b688c4e2fbddbb792c9d02538',owner_project_name='tempest-TestStampPattern-1880881768',owner_user_name='tempest-TestStampPattern-1880881768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:13:03Z,user_data=None,user_id='f00f519b688c4e2fbddbb792c9d02538',uuid=7b091903-0cb2-4e1e-9df9-a7570facb46e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converting VIF {"id": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "address": "fa:16:3e:65:d8:7b", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f1e4bec-a4", "ovs_interfaceid": "3f1e4bec-a4fc-4b6b-a849-57156d17ceed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG os_vif [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f1e4bec-a4, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:16:02 user nova-compute[73091]: INFO os_vif [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d8:7b,bridge_name='br-int',has_traffic_filtering=True,id=3f1e4bec-a4fc-4b6b-a849-57156d17ceed,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f1e4bec-a4')
Aug 16 15:16:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Deleting instance files /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e_del
Aug 16 15:16:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Deletion of /opt/stack/data/nova/instances/7b091903-0cb2-4e1e-9df9-a7570facb46e_del complete
Aug 16 15:16:02 user nova-compute[73091]: INFO nova.compute.manager [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 15:16:02 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Took 0.49 seconds to deallocate network for instance.
Aug 16 15:16:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-704fbca8-75fc-4c29-819f-9246f34c69e0 req-c6b0c9c4-b6be-4cf7-8ef1-4e6c89665e90 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-vif-deleted-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198948.0358467, e1867285-e33a-4b24-8f9e-96886a018a90 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:16:03 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] VM Stopped (Lifecycle Event)
Aug 16 15:16:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7434b0b6-54ad-4545-9bad-f7e6b37cb4d4 None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Deleted allocations for instance 7b091903-0cb2-4e1e-9df9-a7570facb46e
Aug 16 15:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5863edb7-b307-4599-b4c7-50f0c1e8ff71 tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-808044c5-0d01-4eab-87fd-b2657ed6829d req-e67d1719-462d-4ae5-a90e-3109a4080197 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received event network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-808044c5-0d01-4eab-87fd-b2657ed6829d req-e67d1719-462d-4ae5-a90e-3109a4080197 service nova] Acquiring lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-808044c5-0d01-4eab-87fd-b2657ed6829d req-e67d1719-462d-4ae5-a90e-3109a4080197 service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-808044c5-0d01-4eab-87fd-b2657ed6829d req-e67d1719-462d-4ae5-a90e-3109a4080197 service nova] Lock "7b091903-0cb2-4e1e-9df9-a7570facb46e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-808044c5-0d01-4eab-87fd-b2657ed6829d req-e67d1719-462d-4ae5-a90e-3109a4080197 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] No waiting events found dispatching network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:16:03 user nova-compute[73091]: WARNING nova.compute.manager [req-808044c5-0d01-4eab-87fd-b2657ed6829d req-e67d1719-462d-4ae5-a90e-3109a4080197 service nova] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Received unexpected event network-vif-plugged-3f1e4bec-a4fc-4b6b-a849-57156d17ceed for instance with vm_state deleted and task_state None.
Aug 16 15:16:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:16:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:16:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:16:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:16:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:16:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7328MB free_disk=24.998077392578125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7d8df62-ad41-488e-9612-287fee103229 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.969s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:16:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:16:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:16 user nova-compute[73091]: INFO nova.compute.manager [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Terminating instance
Aug 16 15:16:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198961.9719422, 7b091903-0cb2-4e1e-9df9-a7570facb46e => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:16:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] VM Stopped (Lifecycle Event)
Aug 16 15:16:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8d8b751a-2e12-4afc-ae86-0dd305a52eee None None] [instance: 7b091903-0cb2-4e1e-9df9-a7570facb46e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-640d10b1-0d4c-49d5-8663-92d7eacbc3ef req-8cddcea8-e037-4885-86e8-81db53981a1e service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-unplugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-640d10b1-0d4c-49d5-8663-92d7eacbc3ef req-8cddcea8-e037-4885-86e8-81db53981a1e service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-640d10b1-0d4c-49d5-8663-92d7eacbc3ef req-8cddcea8-e037-4885-86e8-81db53981a1e service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-640d10b1-0d4c-49d5-8663-92d7eacbc3ef req-8cddcea8-e037-4885-86e8-81db53981a1e service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-640d10b1-0d4c-49d5-8663-92d7eacbc3ef req-8cddcea8-e037-4885-86e8-81db53981a1e service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-unplugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-640d10b1-0d4c-49d5-8663-92d7eacbc3ef req-8cddcea8-e037-4885-86e8-81db53981a1e service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-unplugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Instance destroyed successfully.
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'resources' on Instance uuid b7d8df62-ad41-488e-9612-287fee103229 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638607342',display_name='tempest-TestMinimumBasicScenario-server-1638607342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638607342',id=27,image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKedjQhiPAMOu3U+iG2SKYrvhmX9Dtktr6EkdHGsqnbuJIWesNok+5qdq5FnXXNXNAey6PPPcUZ9yAuEjiKBULfrO/tYJkZzzU6dQfQZvYtSVkZMjHTmWs+sFalApouOAA==',key_name='tempest-TestMinimumBasicScenario-1184341503',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-tgbq8n5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7528d2d1-a5b6-4a55-aabe-4cbc51a6a2fd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:13:34Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=b7d8df62-ad41-488e-9612-287fee103229,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "address": "fa:16:3e:b0:f8:d9", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae74d8-0d", "ovs_interfaceid": "56ae74d8-0d8d-4492-80a2-174d2c2d85f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG os_vif [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56ae74d8-0d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:17 user nova-compute[73091]: INFO os_vif [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f8:d9,bridge_name='br-int',has_traffic_filtering=True,id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae74d8-0d')
Aug 16 15:16:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Deleting instance files /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229_del
Aug 16 15:16:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Deletion of /opt/stack/data/nova/instances/b7d8df62-ad41-488e-9612-287fee103229_del complete
Aug 16 15:16:17 user nova-compute[73091]: INFO nova.compute.manager [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: b7d8df62-ad41-488e-9612-287fee103229] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 15:16:17 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:16:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:18 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] Took 1.12 seconds to deallocate network for instance.
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-6c7dcd2a-2ef1-43f6-97ef-1372909d0dca req-1cee60f8-9b8c-4a67-9321-f2b2b9415190 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-deleted-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:18 user nova-compute[73091]: INFO nova.compute.manager [req-6c7dcd2a-2ef1-43f6-97ef-1372909d0dca req-1cee60f8-9b8c-4a67-9321-f2b2b9415190 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Neutron deleted interface 56ae74d8-0d8d-4492-80a2-174d2c2d85f1; detaching it from the instance and deleting it from the info cache
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-6c7dcd2a-2ef1-43f6-97ef-1372909d0dca req-1cee60f8-9b8c-4a67-9321-f2b2b9415190 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-6c7dcd2a-2ef1-43f6-97ef-1372909d0dca req-1cee60f8-9b8c-4a67-9321-f2b2b9415190 service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Detach interface failed, port_id=56ae74d8-0d8d-4492-80a2-174d2c2d85f1, reason: Instance b7d8df62-ad41-488e-9612-287fee103229 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [{"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-90c2173a-a2c8-4162-8d81-640cc85ee05a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:16:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:18 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Deleted allocations for instance b7d8df62-ad41-488e-9612-287fee103229
Aug 16 15:16:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d25d453-55be-415c-b876-e0b82abbd463 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "b7d8df62-ad41-488e-9612-287fee103229" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e285fdc-3b14-4717-b4e0-6cd58961cd8b req-97934b97-e06b-4975-a763-3c1abc64b6cb service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e285fdc-3b14-4717-b4e0-6cd58961cd8b req-97934b97-e06b-4975-a763-3c1abc64b6cb service nova] Acquiring lock "b7d8df62-ad41-488e-9612-287fee103229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e285fdc-3b14-4717-b4e0-6cd58961cd8b req-97934b97-e06b-4975-a763-3c1abc64b6cb service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e285fdc-3b14-4717-b4e0-6cd58961cd8b req-97934b97-e06b-4975-a763-3c1abc64b6cb service nova] Lock "b7d8df62-ad41-488e-9612-287fee103229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e285fdc-3b14-4717-b4e0-6cd58961cd8b req-97934b97-e06b-4975-a763-3c1abc64b6cb service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] No waiting events found dispatching network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:16:19 user nova-compute[73091]: WARNING nova.compute.manager [req-8e285fdc-3b14-4717-b4e0-6cd58961cd8b req-97934b97-e06b-4975-a763-3c1abc64b6cb service nova] [instance: b7d8df62-ad41-488e-9612-287fee103229] Received unexpected event network-vif-plugged-56ae74d8-0d8d-4492-80a2-174d2c2d85f1 for instance with vm_state deleted and task_state None.
Aug 16 15:16:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:16:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:16:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:16:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:16:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:16:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:16:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:32 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692198977.1043396, b7d8df62-ad41-488e-9612-287fee103229 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:16:32 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b7d8df62-ad41-488e-9612-287fee103229] VM Stopped (Lifecycle Event)
Aug 16 15:16:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-08cee839-991e-4d9d-b545-5522534a1df3 None None] [instance: b7d8df62-ad41-488e-9612-287fee103229] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:16:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:42 user nova-compute[73091]: INFO nova.compute.manager [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Terminating instance
Aug 16 15:16:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-02c79216-7713-41f7-b459-86aaa3bd8572 req-4d85b640-026c-44ce-b097-68a306203de0 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-unplugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-02c79216-7713-41f7-b459-86aaa3bd8572 req-4d85b640-026c-44ce-b097-68a306203de0 service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-02c79216-7713-41f7-b459-86aaa3bd8572 req-4d85b640-026c-44ce-b097-68a306203de0 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-02c79216-7713-41f7-b459-86aaa3bd8572 req-4d85b640-026c-44ce-b097-68a306203de0 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-02c79216-7713-41f7-b459-86aaa3bd8572 req-4d85b640-026c-44ce-b097-68a306203de0 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-unplugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-02c79216-7713-41f7-b459-86aaa3bd8572 req-4d85b640-026c-44ce-b097-68a306203de0 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-unplugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:16:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Instance destroyed successfully.
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'resources' on Instance uuid 90c2173a-a2c8-4162-8d81-640cc85ee05a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056364814',display_name='tempest-ServerRescueNegativeTestJSON-server-2056364814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056364814',id=5,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:02:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-tz06aexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:13Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=90c2173a-a2c8-4162-8d81-640cc85ee05a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0033d35a-c433-418f-8abf-383712f7aa19", "address": "fa:16:3e:01:a6:0b", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0033d35a-c4", "ovs_interfaceid": "0033d35a-c433-418f-8abf-383712f7aa19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG os_vif [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0033d35a-c4, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:16:43 user nova-compute[73091]: INFO os_vif [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:a6:0b,bridge_name='br-int',has_traffic_filtering=True,id=0033d35a-c433-418f-8abf-383712f7aa19,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0033d35a-c4')
Aug 16 15:16:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Deleting instance files /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a_del
Aug 16 15:16:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Deletion of /opt/stack/data/nova/instances/90c2173a-a2c8-4162-8d81-640cc85ee05a_del complete
Aug 16 15:16:43 user nova-compute[73091]: INFO nova.compute.manager [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 15:16:43 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:16:43 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:44 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Took 0.50 seconds to deallocate network for instance.
Aug 16 15:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ee99b5b-8e1b-4fe8-8f46-8b0c6bea3de8 req-4cada884-fa1f-4984-942e-e2157add7dfa service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-deleted-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:44 user nova-compute[73091]: INFO nova.compute.manager [req-3ee99b5b-8e1b-4fe8-8f46-8b0c6bea3de8 req-4cada884-fa1f-4984-942e-e2157add7dfa service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Neutron deleted interface 0033d35a-c433-418f-8abf-383712f7aa19; detaching it from the instance and deleting it from the info cache
Aug 16 15:16:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-3ee99b5b-8e1b-4fe8-8f46-8b0c6bea3de8 req-4cada884-fa1f-4984-942e-e2157add7dfa service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ee99b5b-8e1b-4fe8-8f46-8b0c6bea3de8 req-4cada884-fa1f-4984-942e-e2157add7dfa service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Detach interface failed, port_id=0033d35a-c433-418f-8abf-383712f7aa19, reason: Instance 90c2173a-a2c8-4162-8d81-640cc85ee05a could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:44 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Deleted allocations for instance 90c2173a-a2c8-4162-8d81-640cc85ee05a
Aug 16 15:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7568b00c-5825-44d8-8fa4-a67c51de1f66 tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ec8e30c-d027-49f8-9c2e-c32be6e44cac req-d1bb8146-1599-4aa3-b68e-4a4db5108e26 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ec8e30c-d027-49f8-9c2e-c32be6e44cac req-d1bb8146-1599-4aa3-b68e-4a4db5108e26 service nova] Acquiring lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ec8e30c-d027-49f8-9c2e-c32be6e44cac req-d1bb8146-1599-4aa3-b68e-4a4db5108e26 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ec8e30c-d027-49f8-9c2e-c32be6e44cac req-d1bb8146-1599-4aa3-b68e-4a4db5108e26 service nova] Lock "90c2173a-a2c8-4162-8d81-640cc85ee05a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ec8e30c-d027-49f8-9c2e-c32be6e44cac req-d1bb8146-1599-4aa3-b68e-4a4db5108e26 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] No waiting events found dispatching network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:16:45 user nova-compute[73091]: WARNING nova.compute.manager [req-3ec8e30c-d027-49f8-9c2e-c32be6e44cac req-d1bb8146-1599-4aa3-b68e-4a4db5108e26 service nova] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Received unexpected event network-vif-plugged-0033d35a-c433-418f-8abf-383712f7aa19 for instance with vm_state deleted and task_state None.
Aug 16 15:16:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid b6791c34-3d16-4317-b1ca-f698edda9780 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "daf4f67c-fc4a-4386-8347-07c350412126" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "daf4f67c-fc4a-4386-8347-07c350412126" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:16:58 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199003.6692092, 90c2173a-a2c8-4162-8d81-640cc85ee05a => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:16:58 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] VM Stopped (Lifecycle Event)
Aug 16 15:16:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2f069592-8df8-4823-81a8-5dd55633be2e None None] [instance: 90c2173a-a2c8-4162-8d81-640cc85ee05a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:16:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:17:10 user nova-compute[73091]: INFO nova.compute.claims [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Claim successful on node user
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-changed-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Refreshing instance network info cache due to event network-changed-e965c54c-3553-4055-946d-90c0a9225618. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] Acquiring lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] Acquired lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Refreshing network info cache for port e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Terminating instance
Aug 16 15:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:17:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.policy [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceda77fdee15448c9c18cc1a1c64d0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc077091084e3da6c5eba044a428bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updated VIF entry in instance network info cache for port e965c54c-3553-4055-946d-90c0a9225618. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating instance_info_cache with network_info: [{"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87a9210c-2b47-4ecd-ae50-e3a65ef12746 req-b1d2f30f-df39-4f5b-a829-b98d278d113d service nova] Releasing lock "refresh_cache-fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:17:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Instance destroyed successfully.
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lazy-loading 'resources' on Instance uuid fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:17:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Creating image(s)
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "/opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "/opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "/opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "ca7034b8c3b26b53b5cd0eece37035f8872f97d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "ca7034b8c3b26b53b5cd0eece37035f8872f97d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-532972590',display_name='tempest-TestStampPattern-server-532972590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-532972590',id=26,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyyAHLuiEqk4ejPwZhUcUKJyBqGOrb26zCZeDgHOg2VmzOCttHuqlkmEdCyFVOyQf9aIP2jNoS5d8k16YNuBnyk8HTbk6rg3OFMv70c4z0S2JbDt5MlYiurLWhEiKpxw==',key_name='tempest-TestStampPattern-728212450',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb0baba8e83d4fde9afda048ecd7b317',ramdisk_id='',reservation_id='r-0hp1ae6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1880881768',owner_user_name='tempest-TestStampPattern-1880881768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:12:50Z,user_data=None,user_id='f00f519b688c4e2fbddbb792c9d02538',uuid=fd4b79ad-6f00-41f3-addc-ada5aa1f84f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converting VIF {"id": "e965c54c-3553-4055-946d-90c0a9225618", "address": "fa:16:3e:bb:d7:03", "network": {"id": "425fa615-7b1a-4b4f-85e5-ac7344959edd", "bridge": "br-int", "label": "tempest-TestStampPattern-828578776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0baba8e83d4fde9afda048ecd7b317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape965c54c-35", "ovs_interfaceid": "e965c54c-3553-4055-946d-90c0a9225618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG os_vif [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape965c54c-35, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:17:11 user nova-compute[73091]: INFO os_vif [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:d7:03,bridge_name='br-int',has_traffic_filtering=True,id=e965c54c-3553-4055-946d-90c0a9225618,network=Network(425fa615-7b1a-4b4f-85e5-ac7344959edd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965c54c-35')
Aug 16 15:17:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Deleting instance files /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6_del
Aug 16 15:17:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Deletion of /opt/stack/data/nova/instances/fd4b79ad-6f00-41f3-addc-ada5aa1f84f6_del complete
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752/disk --force-share --output=json" returned: 0 in 0.520s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Successfully created port: 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:12 user nova-compute[73091]: INFO nova.compute.manager [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG nova.virt.images [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] 83af4770-1980-46e6-b3db-047cd7d92ad4 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.part /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.part /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.converted" returned: 0 in 0.417s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-vif-unplugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] No waiting events found dispatching network-vif-unplugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-vif-unplugged-e965c54c-3553-4055-946d-90c0a9225618 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] Acquiring lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] No waiting events found dispatching network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:13 user nova-compute[73091]: WARNING nova.compute.manager [req-470e7dc4-45e7-4534-b32a-dfac7363827b req-846664f6-3fa6-45f2-975f-81d58b415d56 service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received unexpected event network-vif-plugged-e965c54c-3553-4055-946d-90c0a9225618 for instance with vm_state active and task_state deleting.
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Took 0.68 seconds to deallocate network for instance.
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-396cdf24-f929-4ffb-864b-b750a71c90ff req-7fdc8eca-2280-4390-9127-dabb5339f1fd service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Received event network-vif-deleted-e965c54c-3553-4055-946d-90c0a9225618 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:13 user nova-compute[73091]: INFO nova.compute.manager [req-396cdf24-f929-4ffb-864b-b750a71c90ff req-7fdc8eca-2280-4390-9127-dabb5339f1fd service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Neutron deleted interface e965c54c-3553-4055-946d-90c0a9225618; detaching it from the instance and deleting it from the info cache
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-396cdf24-f929-4ffb-864b-b750a71c90ff req-7fdc8eca-2280-4390-9127-dabb5339f1fd service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-396cdf24-f929-4ffb-864b-b750a71c90ff req-7fdc8eca-2280-4390-9127-dabb5339f1fd service nova] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Detach interface failed, port_id=e965c54c-3553-4055-946d-90c0a9225618, reason: Instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "ca7034b8c3b26b53b5cd0eece37035f8872f97d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.408s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Successfully updated port: 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "ca7034b8c3b26b53b5cd0eece37035f8872f97d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "ca7034b8c3b26b53b5cd0eece37035f8872f97d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 --force-share --output=json" returned: 0 in 0.233s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3,backing_fmt=raw /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3,backing_fmt=raw /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk 1073741824" returned: 0 in 0.058s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "ca7034b8c3b26b53b5cd0eece37035f8872f97d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance network_info: |[{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 --force-share --output=json" returned: 0 in 0.646s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.185s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:17:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7705MB free_disk=25.161231994628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:14 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Deleted allocations for instance fd4b79ad-6f00-41f3-addc-ada5aa1f84f6
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Cannot resize image /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'migration_context' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Ensure instance console log exists: /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Start _get_guest_xml network_info=[{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T15:17:08Z,direct_url=<?>,disk_format='qcow2',id=83af4770-1980-46e6-b3db-047cd7d92ad4,min_disk=0,min_ram=0,name='tempest-scenario-img--1041216763',owner='eccc077091084e3da6c5eba044a428bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T15:17:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '83af4770-1980-46e6-b3db-047cd7d92ad4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19e66db8-59da-4b92-9212-40c55d9b778b tempest-TestStampPattern-1880881768 tempest-TestStampPattern-1880881768-project-member] Lock "fd4b79ad-6f00-41f3-addc-ada5aa1f84f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.624s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:17:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:17:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T15:17:08Z,direct_url=<?>,disk_format='qcow2',id=83af4770-1980-46e6-b3db-047cd7d92ad4,min_disk=0,min_ram=0,name='tempest-scenario-img--1041216763',owner='eccc077091084e3da6c5eba044a428bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T15:17:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2131393725',display_name='tempest-TestMinimumBasicScenario-server-2131393725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2131393725',id=34,image_ref='83af4770-1980-46e6-b3db-047cd7d92ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnslhFeTBWMyP4VfSZdOrmH/JSibs/6GQP81I1H0Cp8J6z04euXHHCBIeU5peBp3nmorBtlYvb8BqoEkAZNVg8QAlY15kmMmATNOrzNiY8tbuZFdtn9C4nRrfrnc9e5TQ==',key_name='tempest-TestMinimumBasicScenario-1646901935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-ev9irch6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='83af4770-1980-46e6-b3db-047cd7d92ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:17:12Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=4962ad4c-43c9-47a0-b26c-991cd8a37cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'pci_devices' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:17:14 user nova-compute[73091]:   <uuid>4962ad4c-43c9-47a0-b26c-991cd8a37cac</uuid>
Aug 16 15:17:14 user nova-compute[73091]:   <name>instance-00000022</name>
Aug 16 15:17:14 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:17:14 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:17:14 user nova-compute[73091]:   <metadata>
Aug 16 15:17:14 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:17:14 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:17:14 user nova-compute[73091]:       <nova:name>tempest-TestMinimumBasicScenario-server-2131393725</nova:name>
Aug 16 15:17:14 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:17:14</nova:creationTime>
Aug 16 15:17:14 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:17:14 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:17:14 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:17:14 user nova-compute[73091]:       <nova:owner>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:user uuid="ceda77fdee15448c9c18cc1a1c64d0fb">tempest-TestMinimumBasicScenario-1639423549-project-member</nova:user>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:project uuid="eccc077091084e3da6c5eba044a428bd">tempest-TestMinimumBasicScenario-1639423549</nova:project>
Aug 16 15:17:14 user nova-compute[73091]:       </nova:owner>
Aug 16 15:17:14 user nova-compute[73091]:       <nova:root type="image" uuid="83af4770-1980-46e6-b3db-047cd7d92ad4"/>
Aug 16 15:17:14 user nova-compute[73091]:       <nova:ports>
Aug 16 15:17:14 user nova-compute[73091]:         <nova:port uuid="71059a4a-105a-4dbd-a8de-808746dcf159">
Aug 16 15:17:14 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:17:14 user nova-compute[73091]:         </nova:port>
Aug 16 15:17:14 user nova-compute[73091]:       </nova:ports>
Aug 16 15:17:14 user nova-compute[73091]:     </nova:instance>
Aug 16 15:17:14 user nova-compute[73091]:   </metadata>
Aug 16 15:17:14 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:17:14 user nova-compute[73091]:     <system>
Aug 16 15:17:14 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:17:14 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:17:14 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:17:14 user nova-compute[73091]:       <entry name="serial">4962ad4c-43c9-47a0-b26c-991cd8a37cac</entry>
Aug 16 15:17:14 user nova-compute[73091]:       <entry name="uuid">4962ad4c-43c9-47a0-b26c-991cd8a37cac</entry>
Aug 16 15:17:14 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:17:14 user nova-compute[73091]:     </system>
Aug 16 15:17:14 user nova-compute[73091]:   </sysinfo>
Aug 16 15:17:14 user nova-compute[73091]:   <os>
Aug 16 15:17:14 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:17:14 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:17:14 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:17:14 user nova-compute[73091]:   </os>
Aug 16 15:17:14 user nova-compute[73091]:   <features>
Aug 16 15:17:14 user nova-compute[73091]:     <acpi/>
Aug 16 15:17:14 user nova-compute[73091]:     <apic/>
Aug 16 15:17:14 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:17:14 user nova-compute[73091]:   </features>
Aug 16 15:17:14 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:17:14 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:17:14 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:17:14 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:17:14 user nova-compute[73091]:   </clock>
Aug 16 15:17:14 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:17:14 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:17:14 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:17:14 user nova-compute[73091]:   </cpu>
Aug 16 15:17:14 user nova-compute[73091]:   <devices>
Aug 16 15:17:14 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:17:14 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:17:14 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk"/>
Aug 16 15:17:14 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:17:14 user nova-compute[73091]:     </disk>
Aug 16 15:17:14 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:17:14 user nova-compute[73091]:       <mac address="fa:16:3e:af:2e:1c"/>
Aug 16 15:17:14 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:17:14 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:17:14 user nova-compute[73091]:       <target dev="tap71059a4a-10"/>
Aug 16 15:17:14 user nova-compute[73091]:     </interface>
Aug 16 15:17:14 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:17:14 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/console.log" append="off"/>
Aug 16 15:17:14 user nova-compute[73091]:     </serial>
Aug 16 15:17:14 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:17:14 user nova-compute[73091]:     <video>
Aug 16 15:17:14 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:17:14 user nova-compute[73091]:     </video>
Aug 16 15:17:14 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:17:14 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:17:14 user nova-compute[73091]:     </rng>
Aug 16 15:17:14 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:17:14 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:17:14 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:17:14 user nova-compute[73091]:     </memballoon>
Aug 16 15:17:14 user nova-compute[73091]:   </devices>
Aug 16 15:17:14 user nova-compute[73091]: </domain>
Aug 16 15:17:14 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2131393725',display_name='tempest-TestMinimumBasicScenario-server-2131393725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2131393725',id=34,image_ref='83af4770-1980-46e6-b3db-047cd7d92ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnslhFeTBWMyP4VfSZdOrmH/JSibs/6GQP81I1H0Cp8J6z04euXHHCBIeU5peBp3nmorBtlYvb8BqoEkAZNVg8QAlY15kmMmATNOrzNiY8tbuZFdtn9C4nRrfrnc9e5TQ==',key_name='tempest-TestMinimumBasicScenario-1646901935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-ev9irch6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='83af4770-1980-46e6-b3db-047cd7d92ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:17:12Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=4962ad4c-43c9-47a0-b26c-991cd8a37cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG os_vif [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71059a4a-10, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71059a4a-10, col_values=(('external_ids', {'iface-id': '71059a4a-105a-4dbd-a8de-808746dcf159', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:2e:1c', 'vm-uuid': '4962ad4c-43c9-47a0-b26c-991cd8a37cac'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:14 user nova-compute[73091]: INFO os_vif [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10')
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No VIF found with MAC fa:16:3e:af:2e:1c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing instance network info cache due to event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:17:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:17:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updated VIF entry in instance network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:17:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-be7bf739-af82-4331-a311-d2202d6d8364 req-50aca676-359b-4552-ad81-4a04acb978f1 service nova] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:17 user nova-compute[73091]: WARNING nova.compute.manager [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state building and task_state spawning.
Aug 16 15:17:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:17 user nova-compute[73091]: WARNING nova.compute.manager [req-3c9ad131-3494-4baa-b611-799dbc908719 req-680ee48b-8d9b-4346-886a-64af1082ce73 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state building and task_state spawning.
Aug 16 15:17:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199038.5790818, 4962ad4c-43c9-47a0-b26c-991cd8a37cac => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] VM Resumed (Lifecycle Event)
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance spawned successfully.
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199038.581532, 4962ad4c-43c9-47a0-b26c-991cd8a37cac => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] VM Started (Lifecycle Event)
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:18 user nova-compute[73091]: INFO nova.compute.manager [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Took 8.18 seconds to build instance.
Aug 16 15:17:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-069a7ff6-c4c4-4647-9428-4227dae3613a tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [{"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b6791c34-3d16-4317-b1ca-f698edda9780" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:21 user nova-compute[73091]: INFO nova.compute.manager [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Terminating instance
Aug 16 15:17:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8757ad94-c63a-498f-80fe-0a852d110db4 req-05cd5034-95e1-4086-9a4b-082fa3dac0b3 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8757ad94-c63a-498f-80fe-0a852d110db4 req-05cd5034-95e1-4086-9a4b-082fa3dac0b3 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8757ad94-c63a-498f-80fe-0a852d110db4 req-05cd5034-95e1-4086-9a4b-082fa3dac0b3 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8757ad94-c63a-498f-80fe-0a852d110db4 req-05cd5034-95e1-4086-9a4b-082fa3dac0b3 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8757ad94-c63a-498f-80fe-0a852d110db4 req-05cd5034-95e1-4086-9a4b-082fa3dac0b3 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8757ad94-c63a-498f-80fe-0a852d110db4 req-05cd5034-95e1-4086-9a4b-082fa3dac0b3 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-unplugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Instance destroyed successfully.
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'resources' on Instance uuid c6017245-2e44-4fd0-9760-2b8f2e9f6df2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1387492187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1387492187',id=30,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-iz7v0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:15:35Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=c6017245-2e44-4fd0-9760-2b8f2e9f6df2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "address": "fa:16:3e:1f:3b:92", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c19b22-d6", "ovs_interfaceid": "e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_vif [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9c19b22-d6, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:17:22 user nova-compute[73091]: INFO os_vif [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c19b22-d6')
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsQSHbpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:17:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a648c-f463-4fb9-a4d6-e6f91fa2db62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e781e2-9644-4100-8049-e45da6d52bc9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:17:22 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:17:22 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:17:22 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:17:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:17:22 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d (non-flash)
Aug 16 15:17:22 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:17:22 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:17:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c58feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ccf95-d028-4909-98e6-b2ac9f3a22ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b531ed-e426-4163-b456-e08713b32ec0]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af24ca52-202f-43d3-82dc-fca6205d19f9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1617c1f6-2ba7-4a8d-b229-441472164d2b]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23463373533646538', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e79564f9', '/dev/disk/by-id/scsi-1SCST_BIOe79564f9-4c753de887789337') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db04d9d-7c67-409b-a223-f0d6e272c351]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d85360-766f-4c85-9861-f6c957bff056]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f788c2-6447-4b71-90e9-f2b33c39642f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260]
Aug 16 15:17:22 user nova-compute[73091]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d, portal: 172.16.0.220,3260] successful.
Aug 16 15:17:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4947e013-c893-4747-8d39-619ae7f31d7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64042cbe-d07c-4eb8-aa31-7b60335e263a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== disconnect_volume: return (324ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:17:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Deleting instance files /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2_del
Aug 16 15:17:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Deletion of /opt/stack/data/nova/instances/c6017245-2e44-4fd0-9760-2b8f2e9f6df2_del complete
Aug 16 15:17:22 user nova-compute[73091]: INFO nova.compute.manager [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 16 15:17:22 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:17:22 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:17:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:23 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Took 0.63 seconds to deallocate network for instance.
Aug 16 15:17:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] Acquiring lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] No waiting events found dispatching network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:23 user nova-compute[73091]: WARNING nova.compute.manager [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received unexpected event network-vif-plugged-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc for instance with vm_state active and task_state deleting.
Aug 16 15:17:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-74ca91f9-78fc-4dd5-ab3c-a435ad4e03ac req-e0d44910-19e9-4f4e-83be-fcc3cafacf00 service nova] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Received event network-vif-deleted-e9c19b22-d6e5-45cb-85aa-fdb2d5a879fc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:24 user nova-compute[73091]: INFO nova.compute.manager [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Took 1.02 seconds to detach 1 volumes for instance.
Aug 16 15:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:24 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:24 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:24 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Deleted allocations for instance c6017245-2e44-4fd0-9760-2b8f2e9f6df2
Aug 16 15:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7df2bfd5-45b6-4b33-9bb0-27ae8b21c315 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "c6017245-2e44-4fd0-9760-2b8f2e9f6df2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.410s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:26 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199031.7309225, fd4b79ad-6f00-41f3-addc-ada5aa1f84f6 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:26 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] VM Stopped (Lifecycle Event)
Aug 16 15:17:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2fefabc-0aec-4f4a-81e5-75763c623570 None None] [instance: fd4b79ad-6f00-41f3-addc-ada5aa1f84f6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:17:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:17:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Terminating instance
Aug 16 15:17:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-a047efd6-f55f-49ff-ab5c-1c28f708058e req-c29734cd-603c-4985-834f-35d0e6871ce4 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a047efd6-f55f-49ff-ab5c-1c28f708058e req-c29734cd-603c-4985-834f-35d0e6871ce4 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a047efd6-f55f-49ff-ab5c-1c28f708058e req-c29734cd-603c-4985-834f-35d0e6871ce4 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a047efd6-f55f-49ff-ab5c-1c28f708058e req-c29734cd-603c-4985-834f-35d0e6871ce4 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-a047efd6-f55f-49ff-ab5c-1c28f708058e req-c29734cd-603c-4985-834f-35d0e6871ce4 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-a047efd6-f55f-49ff-ab5c-1c28f708058e req-c29734cd-603c-4985-834f-35d0e6871ce4 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-unplugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Instance destroyed successfully.
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lazy-loading 'resources' on Instance uuid a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511399511',display_name='tempest-ServerActionsTestOtherB-server-511399511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511399511',id=23,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnytRwqcsivRBpoJxCGvD7bN9Bkvn0VS+kK+dArLNZhE7tbVByyUQpGYemn8IHIaZuxt4QcTLZ0xSc7RenDekht+gYBQhZvfPRhN+sz/Ua4n3w1J+hyuSuPun51bbeWeA==',key_name='tempest-keypair-2056303596',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca74df5f6c3643879a985989a478d33a',ramdisk_id='',reservation_id='r-f0tz8yd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2002245511',owner_user_name='tempest-ServerActionsTestOtherB-2002245511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74c79b9ea11c4d108e57a04ed7052cd4',uuid=a42f48f4-9a4e-4b6f-b61c-59b8ba7de752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converting VIF {"id": "f94a19b5-a285-4efb-9931-8f26831a7382", "address": "fa:16:3e:05:9f:63", "network": {"id": "d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-715503273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca74df5f6c3643879a985989a478d33a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94a19b5-a2", "ovs_interfaceid": "f94a19b5-a285-4efb-9931-8f26831a7382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_vif [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf94a19b5-a2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:17:32 user nova-compute[73091]: INFO os_vif [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9f:63,bridge_name='br-int',has_traffic_filtering=True,id=f94a19b5-a285-4efb-9931-8f26831a7382,network=Network(d0ec3ac9-11fb-4c66-a6da-03d10a5ffcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94a19b5-a2')
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrhAYaNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:17:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58788896-6d72-4831-9735-aa6f6360a066]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590e40d-3bc9-471b-ba1e-4f873a511080]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:17:32 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:17:32 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:17:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:17:32 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:17:32 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 (non-flash)
Aug 16 15:17:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c464790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b32e285-d803-4641-9369-8a8bf9cf83a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd87cd-2732-40ed-9504-3966d2759138]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[500bc557-bc42-4a76-aea5-031e75d54a93]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13e601-3ebb-4818-9f14-27c897d392d0]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b80ca5-dd6a-48ad-89db-577108e9ef50]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4e8ae2-c7a1-4131-b4d6-937fdef653b1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260]
Aug 16 15:17:32 user nova-compute[73091]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67, portal: 172.16.0.220,3260] successful.
Aug 16 15:17:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6502f7-b3a5-4ada-9afe-2c2762bf3e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5057b9de-6997-4ec7-9c04-19aa6d69f1e0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] <== disconnect_volume: return (303ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:17:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Deleting instance files /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752_del
Aug 16 15:17:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Deletion of /opt/stack/data/nova/instances/a42f48f4-9a4e-4b6f-b61c-59b8ba7de752_del complete
Aug 16 15:17:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:32 user nova-compute[73091]: INFO nova.compute.manager [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 16 15:17:32 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:17:32 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:33 user nova-compute[73091]: INFO nova.compute.manager [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Terminating instance
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-4adbcde2-6461-4006-b6bc-fbdbe05444af req-908cbd40-40ca-4349-a0fb-b16c2abe6775 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4adbcde2-6461-4006-b6bc-fbdbe05444af req-908cbd40-40ca-4349-a0fb-b16c2abe6775 service nova] Acquiring lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4adbcde2-6461-4006-b6bc-fbdbe05444af req-908cbd40-40ca-4349-a0fb-b16c2abe6775 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4adbcde2-6461-4006-b6bc-fbdbe05444af req-908cbd40-40ca-4349-a0fb-b16c2abe6775 service nova] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-4adbcde2-6461-4006-b6bc-fbdbe05444af req-908cbd40-40ca-4349-a0fb-b16c2abe6775 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] No waiting events found dispatching network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:33 user nova-compute[73091]: WARNING nova.compute.manager [req-4adbcde2-6461-4006-b6bc-fbdbe05444af req-908cbd40-40ca-4349-a0fb-b16c2abe6775 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received unexpected event network-vif-plugged-f94a19b5-a285-4efb-9931-8f26831a7382 for instance with vm_state active and task_state deleting.
Aug 16 15:17:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Instance destroyed successfully.
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lazy-loading 'resources' on Instance uuid 9498b706-c5d2-4ba8-9d94-bc335fbdca2b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-13584052',display_name='tempest-ServerRescueNegativeTestJSON-server-13584052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-13584052',id=2,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cabeffd95264d63aa6802f8a91387e9',ramdisk_id='',reservation_id='r-soyz7s4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-789793483',owner_user_name='tempest-ServerRescueNegativeTestJSON-789793483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:06:59Z,user_data=None,user_id='9348c14ed1dc496ebf20d26e3b31779a',uuid=9498b706-c5d2-4ba8-9d94-bc335fbdca2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converting VIF {"id": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "address": "fa:16:3e:da:30:1a", "network": {"id": "0a55a376-be4e-4fcd-abe5-5f45d331db13", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1922076927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cabeffd95264d63aa6802f8a91387e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b71273e-c1", "ovs_interfaceid": "0b71273e-c1f5-49dc-9eda-63f7d131828f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:33 user nova-compute[73091]: DEBUG os_vif [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b71273e-c1, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:17:34 user nova-compute[73091]: INFO os_vif [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=0b71273e-c1f5-49dc-9eda-63f7d131828f,network=Network(0a55a376-be4e-4fcd-abe5-5f45d331db13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b71273e-c1')
Aug 16 15:17:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Deleting instance files /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b_del
Aug 16 15:17:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Deletion of /opt/stack/data/nova/instances/9498b706-c5d2-4ba8-9d94-bc335fbdca2b_del complete
Aug 16 15:17:34 user nova-compute[73091]: INFO nova.compute.manager [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 16 15:17:34 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:17:34 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Took 1.71 seconds to deallocate network for instance.
Aug 16 15:17:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-a957694a-62d2-408e-b31c-ee2c6f4e66c9 req-b7bf7698-7a76-42ab-86ec-a09db4f9c701 service nova] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Received event network-vif-deleted-f94a19b5-a285-4efb-9931-8f26831a7382 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:35 user nova-compute[73091]: INFO nova.compute.manager [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Took 0.88 seconds to detach 1 volumes for instance.
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Took 0.99 seconds to deallocate network for instance.
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-a6007485-2c09-4a28-ad9f-6a1025703af0 req-7bb18ab7-7342-4c08-b275-44f9a89ed8d3 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-deleted-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:35 user nova-compute[73091]: INFO nova.compute.manager [req-a6007485-2c09-4a28-ad9f-6a1025703af0 req-7bb18ab7-7342-4c08-b275-44f9a89ed8d3 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Neutron deleted interface 0b71273e-c1f5-49dc-9eda-63f7d131828f; detaching it from the instance and deleting it from the info cache
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-a6007485-2c09-4a28-ad9f-6a1025703af0 req-7bb18ab7-7342-4c08-b275-44f9a89ed8d3 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-a6007485-2c09-4a28-ad9f-6a1025703af0 req-7bb18ab7-7342-4c08-b275-44f9a89ed8d3 service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Detach interface failed, port_id=0b71273e-c1f5-49dc-9eda-63f7d131828f, reason: Instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.310s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:35 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Deleted allocations for instance 9498b706-c5d2-4ba8-9d94-bc335fbdca2b
Aug 16 15:17:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a78f85b-0346-4bcc-9577-0406bff5785d tempest-ServerRescueNegativeTestJSON-789793483 tempest-ServerRescueNegativeTestJSON-789793483-project-member] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:35 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Deleted allocations for instance a42f48f4-9a4e-4b6f-b61c-59b8ba7de752
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6a84587-494e-4001-abee-2e686c840e6b tempest-ServerActionsTestOtherB-2002245511 tempest-ServerActionsTestOtherB-2002245511-project-member] Lock "a42f48f4-9a4e-4b6f-b61c-59b8ba7de752" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.740s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:35 user nova-compute[73091]: WARNING nova.compute.manager [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-unplugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state deleted and task_state None.
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] Acquiring lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] Lock "9498b706-c5d2-4ba8-9d94-bc335fbdca2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] No waiting events found dispatching network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:35 user nova-compute[73091]: WARNING nova.compute.manager [req-dfcb8c8d-d860-403b-be85-6ef23f9de9f3 req-cb028b43-a3e4-4615-861f-7352bcc16c4c service nova] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Received unexpected event network-vif-plugged-0b71273e-c1f5-49dc-9eda-63f7d131828f for instance with vm_state deleted and task_state None.
Aug 16 15:17:37 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199042.2489634, c6017245-2e44-4fd0-9760-2b8f2e9f6df2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:37 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] VM Stopped (Lifecycle Event)
Aug 16 15:17:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-39b7d9f5-52ad-48f4-bb7b-94f74e9bda41 None None] [instance: c6017245-2e44-4fd0-9760-2b8f2e9f6df2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:41 user nova-compute[73091]: INFO nova.compute.manager [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Unshelving
Aug 16 15:17:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'pci_requests' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'numa_topology' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:17:41 user nova-compute[73091]: INFO nova.compute.claims [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Claim successful on node user
Aug 16 15:17:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:17:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:41 user nova-compute[73091]: INFO nova.network.neutron [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating port 7c487e54-2a45-431e-8ac2-0d416e43db0d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing instance network info cache due to event network-changed-7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:17:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:17:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Creating image(s)
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Refreshing network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "1bac8b89082aa8d532438b1c204010332955878b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "1bac8b89082aa8d532438b1c204010332955878b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:44 user nova-compute[73091]: INFO nova.compute.manager [None req-b23f44f4-69a9-4e78-8869-494519f8a1c5 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Get console output
Aug 16 15:17:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.part --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:44 user nova-compute[73091]: DEBUG nova.virt.images [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] 466348fe-c838-418a-b2ca-8fa2f091fe31 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:17:44 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:17:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.part /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:44 user nova-compute[73091]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 15:17:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updated VIF entry in instance network info cache for port 7c487e54-2a45-431e-8ac2-0d416e43db0d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a693647e-3e09-49f8-b06a-43081be05da3 req-4a20f94e-cbce-4b9e-8b73-d4c0f348bb10 service nova] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.part /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.converted" returned: 0 in 0.594s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "1bac8b89082aa8d532438b1c204010332955878b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.170s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "1bac8b89082aa8d532438b1c204010332955878b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "1bac8b89082aa8d532438b1c204010332955878b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b,backing_fmt=raw /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b,backing_fmt=raw /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "1bac8b89082aa8d532438b1c204010332955878b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'migration_context' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Rebasing disk image.
Aug 16 15:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a -F raw /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:17:46 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199051.994139, a42f48f4-9a4e-4b6f-b61c-59b8ba7de752 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:46 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] VM Stopped (Lifecycle Event)
Aug 16 15:17:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-76820998-65a5-43ad-b758-5d70060d2961 None None] [instance: a42f48f4-9a4e-4b6f-b61c-59b8ba7de752] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a -F raw /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk" returned: 0 in 2.219s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Ensure instance console log exists: /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Start _get_guest_xml network_info=[{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b4c5614030703cc59259ee5686aa869c',container_format='bare',created_at=2023-08-16T15:15:47Z,direct_url=<?>,disk_format='qcow2',id=466348fe-c838-418a-b2ca-8fa2f091fe31,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1937008942-shelved',owner='0c198a130ace46eca27de708de492ef7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T15:15:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:17:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:17:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b4c5614030703cc59259ee5686aa869c',container_format='bare',created_at=2023-08-16T15:15:47Z,direct_url=<?>,disk_format='qcow2',id=466348fe-c838-418a-b2ca-8fa2f091fe31,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1937008942-shelved',owner='0c198a130ace46eca27de708de492ef7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T15:15:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937008942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937008942',id=33,image_ref='466348fe-c838-418a-b2ca-8fa2f091fe31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1222551489',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-yytgy2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member',shelved_at='2023-08-16T15:15:51.324847',shelved_host='user',shelved_image_id='466348fe-c838-418a-b2ca-8fa2f091fe31'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=e1867285-e33a-4b24-8f9e-96886a018a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'pci_devices' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:17:48 user nova-compute[73091]:   <uuid>e1867285-e33a-4b24-8f9e-96886a018a90</uuid>
Aug 16 15:17:48 user nova-compute[73091]:   <name>instance-00000021</name>
Aug 16 15:17:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:17:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:17:48 user nova-compute[73091]:   <metadata>
Aug 16 15:17:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:17:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:17:48 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1937008942</nova:name>
Aug 16 15:17:48 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:17:48</nova:creationTime>
Aug 16 15:17:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:17:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:17:48 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:17:48 user nova-compute[73091]:       <nova:owner>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:user uuid="0f6775ee1ca44360920397fd8bbf2899">tempest-AttachVolumeShelveTestJSON-1996332630-project-member</nova:user>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:project uuid="0c198a130ace46eca27de708de492ef7">tempest-AttachVolumeShelveTestJSON-1996332630</nova:project>
Aug 16 15:17:48 user nova-compute[73091]:       </nova:owner>
Aug 16 15:17:48 user nova-compute[73091]:       <nova:root type="image" uuid="466348fe-c838-418a-b2ca-8fa2f091fe31"/>
Aug 16 15:17:48 user nova-compute[73091]:       <nova:ports>
Aug 16 15:17:48 user nova-compute[73091]:         <nova:port uuid="7c487e54-2a45-431e-8ac2-0d416e43db0d">
Aug 16 15:17:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 15:17:48 user nova-compute[73091]:         </nova:port>
Aug 16 15:17:48 user nova-compute[73091]:       </nova:ports>
Aug 16 15:17:48 user nova-compute[73091]:     </nova:instance>
Aug 16 15:17:48 user nova-compute[73091]:   </metadata>
Aug 16 15:17:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:17:48 user nova-compute[73091]:     <system>
Aug 16 15:17:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:17:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:17:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:17:48 user nova-compute[73091]:       <entry name="serial">e1867285-e33a-4b24-8f9e-96886a018a90</entry>
Aug 16 15:17:48 user nova-compute[73091]:       <entry name="uuid">e1867285-e33a-4b24-8f9e-96886a018a90</entry>
Aug 16 15:17:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:17:48 user nova-compute[73091]:     </system>
Aug 16 15:17:48 user nova-compute[73091]:   </sysinfo>
Aug 16 15:17:48 user nova-compute[73091]:   <os>
Aug 16 15:17:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:17:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:17:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:17:48 user nova-compute[73091]:   </os>
Aug 16 15:17:48 user nova-compute[73091]:   <features>
Aug 16 15:17:48 user nova-compute[73091]:     <acpi/>
Aug 16 15:17:48 user nova-compute[73091]:     <apic/>
Aug 16 15:17:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:17:48 user nova-compute[73091]:   </features>
Aug 16 15:17:48 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:17:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:17:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:17:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:17:48 user nova-compute[73091]:   </clock>
Aug 16 15:17:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:17:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:17:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:17:48 user nova-compute[73091]:   </cpu>
Aug 16 15:17:48 user nova-compute[73091]:   <devices>
Aug 16 15:17:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:17:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:17:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk"/>
Aug 16 15:17:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:17:48 user nova-compute[73091]:     </disk>
Aug 16 15:17:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:17:48 user nova-compute[73091]:       <mac address="fa:16:3e:3e:54:00"/>
Aug 16 15:17:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:17:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:17:48 user nova-compute[73091]:       <target dev="tap7c487e54-2a"/>
Aug 16 15:17:48 user nova-compute[73091]:     </interface>
Aug 16 15:17:48 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:17:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/console.log" append="off"/>
Aug 16 15:17:48 user nova-compute[73091]:     </serial>
Aug 16 15:17:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:17:48 user nova-compute[73091]:     <video>
Aug 16 15:17:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:17:48 user nova-compute[73091]:     </video>
Aug 16 15:17:48 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:17:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:17:48 user nova-compute[73091]:     </rng>
Aug 16 15:17:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:17:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:17:48 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:17:48 user nova-compute[73091]:     </memballoon>
Aug 16 15:17:48 user nova-compute[73091]:   </devices>
Aug 16 15:17:48 user nova-compute[73091]: </domain>
Aug 16 15:17:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937008942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937008942',id=33,image_ref='466348fe-c838-418a-b2ca-8fa2f091fe31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1222551489',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-yytgy2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member',shelved_at='2023-08-16T15:15:51.324847',shelved_host='user',shelved_image_id='466348fe-c838-418a-b2ca-8fa2f091fe31'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=e1867285-e33a-4b24-8f9e-96886a018a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG os_vif [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c487e54-2a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c487e54-2a, col_values=(('external_ids', {'iface-id': '7c487e54-2a45-431e-8ac2-0d416e43db0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:54:00', 'vm-uuid': 'e1867285-e33a-4b24-8f9e-96886a018a90'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:48 user nova-compute[73091]: INFO os_vif [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a')
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] No VIF found with MAC fa:16:3e:3e:54:00, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199053.9753191, 9498b706-c5d2-4ba8-9d94-bc335fbdca2b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] VM Stopped (Lifecycle Event)
Aug 16 15:17:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d4da56bd-f030-4642-8973-93f6927e4958 None None] [instance: 9498b706-c5d2-4ba8-9d94-bc335fbdca2b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-f5176621-bbea-4698-9a73-8de460e7ae62 req-62c2acab-8640-47fa-b721-94f8dd8530ed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f5176621-bbea-4698-9a73-8de460e7ae62 req-62c2acab-8640-47fa-b721-94f8dd8530ed service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f5176621-bbea-4698-9a73-8de460e7ae62 req-62c2acab-8640-47fa-b721-94f8dd8530ed service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f5176621-bbea-4698-9a73-8de460e7ae62 req-62c2acab-8640-47fa-b721-94f8dd8530ed service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-f5176621-bbea-4698-9a73-8de460e7ae62 req-62c2acab-8640-47fa-b721-94f8dd8530ed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:50 user nova-compute[73091]: WARNING nova.compute.manager [req-f5176621-bbea-4698-9a73-8de460e7ae62 req-62c2acab-8640-47fa-b721-94f8dd8530ed service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199072.2994668, e1867285-e33a-4b24-8f9e-96886a018a90 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:52 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] VM Resumed (Lifecycle Event)
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:17:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance spawned successfully.
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-960ff539-58c3-494d-910e-ec9c079e0fa4 req-4b8cf4c5-5785-425f-b696-480cb7cf7e41 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-960ff539-58c3-494d-910e-ec9c079e0fa4 req-4b8cf4c5-5785-425f-b696-480cb7cf7e41 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-960ff539-58c3-494d-910e-ec9c079e0fa4 req-4b8cf4c5-5785-425f-b696-480cb7cf7e41 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-960ff539-58c3-494d-910e-ec9c079e0fa4 req-4b8cf4c5-5785-425f-b696-480cb7cf7e41 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-960ff539-58c3-494d-910e-ec9c079e0fa4 req-4b8cf4c5-5785-425f-b696-480cb7cf7e41 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:17:52 user nova-compute[73091]: WARNING nova.compute.manager [req-960ff539-58c3-494d-910e-ec9c079e0fa4 req-4b8cf4c5-5785-425f-b696-480cb7cf7e41 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 15:17:52 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199072.3030365, e1867285-e33a-4b24-8f9e-96886a018a90 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:17:52 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] VM Started (Lifecycle Event)
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:17:52 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa94226e-3d6b-4a83-be73-42fc8a2d463a tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.836s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:17:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:17:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:18:02 user nova-compute[73091]: INFO nova.compute.claims [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Claim successful on node user
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:18:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:18:02 user nova-compute[73091]: DEBUG nova.policy [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab71a5471a4bbcb7845d1293849449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f7da218a484e86a7c25626b2e178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:18:02 user nova-compute[73091]: INFO nova.virt.block_device [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Booting with volume snapshot 04aca80d-9de5-4a6a-bcf9-7a21bd607899 at /dev/vda
Aug 16 15:18:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Successfully created port: c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Successfully updated port: c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "refresh_cache-ba8ec8b1-1837-45db-aa6b-76146255a8fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquired lock "refresh_cache-ba8ec8b1-1837-45db-aa6b-76146255a8fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-changed-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Refreshing instance network info cache due to event network-changed-c5ced08d-f28d-4bdd-952d-288a7771b400. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] Acquiring lock "refresh_cache-ba8ec8b1-1837-45db-aa6b-76146255a8fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Updating instance_info_cache with network_info: [{"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Releasing lock "refresh_cache-ba8ec8b1-1837-45db-aa6b-76146255a8fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Instance network_info: |[{"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] Acquired lock "refresh_cache-ba8ec8b1-1837-45db-aa6b-76146255a8fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:18:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Refreshing network info cache for port c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:18:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Updated VIF entry in instance network info cache for port c5ced08d-f28d-4bdd-952d-288a7771b400. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:18:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Updating instance_info_cache with network_info: [{"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-02f1c7f9-2cf1-4e95-b5a3-dc4944744c1f req-28bab4fd-ae19-4a4a-9bc7-cd0bf9caca84 service nova] Releasing lock "refresh_cache-ba8ec8b1-1837-45db-aa6b-76146255a8fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca6d06-7a01-4226-834e-40ca61df3b08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5706b-043b-4ba4-a3a2-493434e193fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a55d8f-55c3-47a1-913c-3b753f29da75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db062be8-95b1-4d33-8658-c2870e3a33ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:18:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:18:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd693374-86b5-4088-a6e1-f30ac57e177d]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Updating existing volume attachment record: fcb4fb7e-62b7-450a-b325-82c352cebcd2 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:18:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:18:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:18:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7863MB free_disk=25.146713256835938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:13 user nova-compute[73091]: INFO nova.compute.manager [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Terminating instance
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 8e6d2c04-e78d-439f-8259-e3fae71840ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e1867285-e33a-4b24-8f9e-96886a018a90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance ba8ec8b1-1837-45db-aa6b-76146255a8fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8b3b5d6-df5b-4162-b2b7-8436f824cc6f req-57d93362-f94a-47c0-9ac7-24e4be4a8a00 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-vif-unplugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8b3b5d6-df5b-4162-b2b7-8436f824cc6f req-57d93362-f94a-47c0-9ac7-24e4be4a8a00 service nova] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8b3b5d6-df5b-4162-b2b7-8436f824cc6f req-57d93362-f94a-47c0-9ac7-24e4be4a8a00 service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8b3b5d6-df5b-4162-b2b7-8436f824cc6f req-57d93362-f94a-47c0-9ac7-24e4be4a8a00 service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8b3b5d6-df5b-4162-b2b7-8436f824cc6f req-57d93362-f94a-47c0-9ac7-24e4be4a8a00 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] No waiting events found dispatching network-vif-unplugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8b3b5d6-df5b-4162-b2b7-8436f824cc6f req-57d93362-f94a-47c0-9ac7-24e4be4a8a00 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-vif-unplugged-d42c541f-033a-4758-a092-068b7eeb509e for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Instance destroyed successfully.
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'resources' on Instance uuid 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068748105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068748105',id=24,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:08:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-i8te08g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:10:46Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=1b71c1e6-8c5a-4052-b33f-6c7ebed69879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "d42c541f-033a-4758-a092-068b7eeb509e", "address": "fa:16:3e:ab:7c:47", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42c541f-03", "ovs_interfaceid": "d42c541f-033a-4758-a092-068b7eeb509e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG os_vif [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd42c541f-03, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:18:13 user nova-compute[73091]: INFO os_vif [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:47,bridge_name='br-int',has_traffic_filtering=True,id=d42c541f-033a-4758-a092-068b7eeb509e,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42c541f-03')
Aug 16 15:18:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Deleting instance files /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879_del
Aug 16 15:18:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Deletion of /opt/stack/data/nova/instances/1b71c1e6-8c5a-4052-b33f-6c7ebed69879_del complete
Aug 16 15:18:13 user nova-compute[73091]: INFO nova.compute.manager [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 16 15:18:13 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:18:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:18:14 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Took 1.04 seconds to deallocate network for instance.
Aug 16 15:18:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-c215b46e-2204-451a-b72e-d5836cd0b9c2 req-bc327d43-210a-42eb-9722-09c9514a4dc5 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-vif-deleted-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:15 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Deleted allocations for instance 1b71c1e6-8c5a-4052-b33f-6c7ebed69879
Aug 16 15:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-30627738-4220-4739-8b70-778645cb4f55 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-a417eec5-2acc-4d40-bbaa-4532efc7966a req-8050658d-32c0-4d18-ac65-382bcc943da6 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received event network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a417eec5-2acc-4d40-bbaa-4532efc7966a req-8050658d-32c0-4d18-ac65-382bcc943da6 service nova] Acquiring lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a417eec5-2acc-4d40-bbaa-4532efc7966a req-8050658d-32c0-4d18-ac65-382bcc943da6 service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a417eec5-2acc-4d40-bbaa-4532efc7966a req-8050658d-32c0-4d18-ac65-382bcc943da6 service nova] Lock "1b71c1e6-8c5a-4052-b33f-6c7ebed69879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-a417eec5-2acc-4d40-bbaa-4532efc7966a req-8050658d-32c0-4d18-ac65-382bcc943da6 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] No waiting events found dispatching network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:15 user nova-compute[73091]: WARNING nova.compute.manager [req-a417eec5-2acc-4d40-bbaa-4532efc7966a req-8050658d-32c0-4d18-ac65-382bcc943da6 service nova] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Received unexpected event network-vif-plugged-d42c541f-033a-4758-a092-068b7eeb509e for instance with vm_state deleted and task_state None.
Aug 16 15:18:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:18:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [{"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:18:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Creating image(s)
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Ensure instance console log exists: /opt/stack/data/nova/instances/ba8ec8b1-1837-45db-aa6b-76146255a8fe/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Start _get_guest_xml network_info=[{"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'fcb4fb7e-62b7-450a-b325-82c352cebcd2', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmfhHWdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba8ec8b1-1837-45db-aa6b-76146255a8fe', 'attached_at': '', 'detached_at': '', 'volume_id': '78c9b9de-a84b-4897-860d-78decac806a3', 'serial': '78c9b9de-a84b-4897-860d-78decac806a3'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:18:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:18:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmfhHWdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:18:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:18:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:18:19 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66f047-0717-4e78-8b9b-c67d99e0219e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:18:19 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0417da-5b77-431b-9b17-8e069e81d71b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3] added
Aug 16 15:18:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11bd621-d813-41a2-8c79-cf28d0d61bc5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a10fd69-391d-4936-b218-220e4e660f6f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bmfhHWdO {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bmfhHWdO" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70447987-be02-48a0-ba5a-2bd5614d85b7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bmfhHWdO'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02953676-ac6a-4f56-a933-9954cef8451c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[200d34b3-8cf2-4e81-b189-395e145e1be7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:18:19 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:18:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:18:19 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:18:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[416a1cf5-bd3b-4152-a560-731327d37e1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260]
Aug 16 15:18:20 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260] successful.
Aug 16 15:18:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[62571b43-ebef-409a-b3c3-147be35b35e8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8355a7ec-ae9d-4fa1-baf4-0096de50e332]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:18:20 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:18:20 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:18:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:18:20 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:18:20 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:18:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe388d-0049-484c-9f44-bda57f9db1ca]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:18:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmfhHWdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23366643566383537', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366643566383537', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-456316243',display_name='tempest-TestVolumeBootPattern-server-456316243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-456316243',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-kws07ltx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:18:03Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=ba8ec8b1-1837-45db-aa6b-76146255a8fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'pci_devices' on Instance uuid ba8ec8b1-1837-45db-aa6b-76146255a8fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:18:21 user nova-compute[73091]:   <uuid>ba8ec8b1-1837-45db-aa6b-76146255a8fe</uuid>
Aug 16 15:18:21 user nova-compute[73091]:   <name>instance-00000023</name>
Aug 16 15:18:21 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:18:21 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:18:21 user nova-compute[73091]:   <metadata>
Aug 16 15:18:21 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:18:21 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:18:21 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-456316243</nova:name>
Aug 16 15:18:21 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:18:19</nova:creationTime>
Aug 16 15:18:21 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:18:21 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:18:21 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:18:21 user nova-compute[73091]:       <nova:owner>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:user uuid="b8ab71a5471a4bbcb7845d1293849449">tempest-TestVolumeBootPattern-1172028538-project-member</nova:user>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:project uuid="1236f7da218a484e86a7c25626b2e178">tempest-TestVolumeBootPattern-1172028538</nova:project>
Aug 16 15:18:21 user nova-compute[73091]:       </nova:owner>
Aug 16 15:18:21 user nova-compute[73091]:       <nova:ports>
Aug 16 15:18:21 user nova-compute[73091]:         <nova:port uuid="c5ced08d-f28d-4bdd-952d-288a7771b400">
Aug 16 15:18:21 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:18:21 user nova-compute[73091]:         </nova:port>
Aug 16 15:18:21 user nova-compute[73091]:       </nova:ports>
Aug 16 15:18:21 user nova-compute[73091]:     </nova:instance>
Aug 16 15:18:21 user nova-compute[73091]:   </metadata>
Aug 16 15:18:21 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:18:21 user nova-compute[73091]:     <system>
Aug 16 15:18:21 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:18:21 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:18:21 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:18:21 user nova-compute[73091]:       <entry name="serial">ba8ec8b1-1837-45db-aa6b-76146255a8fe</entry>
Aug 16 15:18:21 user nova-compute[73091]:       <entry name="uuid">ba8ec8b1-1837-45db-aa6b-76146255a8fe</entry>
Aug 16 15:18:21 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:18:21 user nova-compute[73091]:     </system>
Aug 16 15:18:21 user nova-compute[73091]:   </sysinfo>
Aug 16 15:18:21 user nova-compute[73091]:   <os>
Aug 16 15:18:21 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:18:21 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:18:21 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:18:21 user nova-compute[73091]:   </os>
Aug 16 15:18:21 user nova-compute[73091]:   <features>
Aug 16 15:18:21 user nova-compute[73091]:     <acpi/>
Aug 16 15:18:21 user nova-compute[73091]:     <apic/>
Aug 16 15:18:21 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:18:21 user nova-compute[73091]:   </features>
Aug 16 15:18:21 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:18:21 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:18:21 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:18:21 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:18:21 user nova-compute[73091]:   </clock>
Aug 16 15:18:21 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:18:21 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:18:21 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:18:21 user nova-compute[73091]:   </cpu>
Aug 16 15:18:21 user nova-compute[73091]:   <devices>
Aug 16 15:18:21 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:18:21 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:18:21 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:18:21 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:18:21 user nova-compute[73091]:       <serial>78c9b9de-a84b-4897-860d-78decac806a3</serial>
Aug 16 15:18:21 user nova-compute[73091]:     </disk>
Aug 16 15:18:21 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:18:21 user nova-compute[73091]:       <mac address="fa:16:3e:9c:8e:fa"/>
Aug 16 15:18:21 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:18:21 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:18:21 user nova-compute[73091]:       <target dev="tapc5ced08d-f2"/>
Aug 16 15:18:21 user nova-compute[73091]:     </interface>
Aug 16 15:18:21 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:18:21 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/ba8ec8b1-1837-45db-aa6b-76146255a8fe/console.log" append="off"/>
Aug 16 15:18:21 user nova-compute[73091]:     </serial>
Aug 16 15:18:21 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:18:21 user nova-compute[73091]:     <video>
Aug 16 15:18:21 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:18:21 user nova-compute[73091]:     </video>
Aug 16 15:18:21 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:18:21 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:18:21 user nova-compute[73091]:     </rng>
Aug 16 15:18:21 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:18:21 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:18:21 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:18:21 user nova-compute[73091]:     </memballoon>
Aug 16 15:18:21 user nova-compute[73091]:   </devices>
Aug 16 15:18:21 user nova-compute[73091]: </domain>
Aug 16 15:18:21 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-456316243',display_name='tempest-TestVolumeBootPattern-server-456316243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-456316243',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-kws07ltx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:18:03Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=ba8ec8b1-1837-45db-aa6b-76146255a8fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG os_vif [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5ced08d-f2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5ced08d-f2, col_values=(('external_ids', {'iface-id': 'c5ced08d-f28d-4bdd-952d-288a7771b400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:8e:fa', 'vm-uuid': 'ba8ec8b1-1837-45db-aa6b-76146255a8fe'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:21 user nova-compute[73091]: INFO os_vif [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2')
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:18:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No VIF found with MAC fa:16:3e:9c:8e:fa, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-98cc1ae6-59f6-46d5-8de3-0085dfed998d req-77551328-7582-4f72-a323-cf71118f18b3 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98cc1ae6-59f6-46d5-8de3-0085dfed998d req-77551328-7582-4f72-a323-cf71118f18b3 service nova] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98cc1ae6-59f6-46d5-8de3-0085dfed998d req-77551328-7582-4f72-a323-cf71118f18b3 service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98cc1ae6-59f6-46d5-8de3-0085dfed998d req-77551328-7582-4f72-a323-cf71118f18b3 service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-98cc1ae6-59f6-46d5-8de3-0085dfed998d req-77551328-7582-4f72-a323-cf71118f18b3 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] No waiting events found dispatching network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:22 user nova-compute[73091]: WARNING nova.compute.manager [req-98cc1ae6-59f6-46d5-8de3-0085dfed998d req-77551328-7582-4f72-a323-cf71118f18b3 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received unexpected event network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 for instance with vm_state building and task_state spawning.
Aug 16 15:18:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199104.7587752, ba8ec8b1-1837-45db-aa6b-76146255a8fe => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] VM Resumed (Lifecycle Event)
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0466e9c0-dd8b-4b21-915f-3c290c9966f6 req-de3f344c-0c80-49d5-ab5b-81c51c14925a service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0466e9c0-dd8b-4b21-915f-3c290c9966f6 req-de3f344c-0c80-49d5-ab5b-81c51c14925a service nova] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0466e9c0-dd8b-4b21-915f-3c290c9966f6 req-de3f344c-0c80-49d5-ab5b-81c51c14925a service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0466e9c0-dd8b-4b21-915f-3c290c9966f6 req-de3f344c-0c80-49d5-ab5b-81c51c14925a service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0466e9c0-dd8b-4b21-915f-3c290c9966f6 req-de3f344c-0c80-49d5-ab5b-81c51c14925a service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] No waiting events found dispatching network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:24 user nova-compute[73091]: WARNING nova.compute.manager [req-0466e9c0-dd8b-4b21-915f-3c290c9966f6 req-de3f344c-0c80-49d5-ab5b-81c51c14925a service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received unexpected event network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 for instance with vm_state building and task_state spawning.
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Instance spawned successfully.
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199104.7603502, ba8ec8b1-1837-45db-aa6b-76146255a8fe => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] VM Started (Lifecycle Event)
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 16 15:18:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:24 user nova-compute[73091]: INFO nova.compute.manager [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Took 22.90 seconds to build instance.
Aug 16 15:18:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4b0f8f3-6019-4187-a531-602e4e75d220 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.030s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:28 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199093.7478342, 1b71c1e6-8c5a-4052-b33f-6c7ebed69879 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:18:28 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] VM Stopped (Lifecycle Event)
Aug 16 15:18:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9422bd2-43d2-4149-9bb9-0418b6610fd1 None None] [instance: 1b71c1e6-8c5a-4052-b33f-6c7ebed69879] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:18:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:18:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:45 user nova-compute[73091]: INFO nova.compute.manager [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Terminating instance
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:18:45 user nova-compute[73091]: INFO nova.compute.claims [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Claim successful on node user
Aug 16 15:18:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-e7c18f13-1559-44f2-a6de-f0d79f2afa84 req-f610e215-8605-4280-991c-b81855c5b498 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-unplugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e7c18f13-1559-44f2-a6de-f0d79f2afa84 req-f610e215-8605-4280-991c-b81855c5b498 service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e7c18f13-1559-44f2-a6de-f0d79f2afa84 req-f610e215-8605-4280-991c-b81855c5b498 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e7c18f13-1559-44f2-a6de-f0d79f2afa84 req-f610e215-8605-4280-991c-b81855c5b498 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-e7c18f13-1559-44f2-a6de-f0d79f2afa84 req-f610e215-8605-4280-991c-b81855c5b498 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-unplugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-e7c18f13-1559-44f2-a6de-f0d79f2afa84 req-f610e215-8605-4280-991c-b81855c5b498 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-unplugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:18:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:18:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.policy [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4323609874c6400a986d1041316e8e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa8ad962c43d4997806056d83f4a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:18:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Creating image(s)
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Instance destroyed successfully.
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'resources' on Instance uuid 8e6d2c04-e78d-439f-8259-e3fae71840ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-239578980',display_name='tempest-ServerActionsTestOtherA-server-239578980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-239578980',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-xpmo7ft2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=8e6d2c04-e78d-439f-8259-e3fae71840ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "address": "fa:16:3e:b0:68:25", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49080ee5-1f", "ovs_interfaceid": "49080ee5-1f91-48ce-a4f3-c17e08515a4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_vif [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49080ee5-1f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:18:46 user nova-compute[73091]: INFO os_vif [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:68:25,bridge_name='br-int',has_traffic_filtering=True,id=49080ee5-1f91-48ce-a4f3-c17e08515a4c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49080ee5-1f')
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIGfFpKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:18:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e19351-b105-495e-943c-4a2a73c65309]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9550ea3-9164-4871-981d-b866d4515c60]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:18:46 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:18:46 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:18:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:18:46 user nova-compute[73091]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 (non-flash)
Aug 16 15:18:46 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:18:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c464f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af476ae5-6118-4e23-8b35-2caeabc639f6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda6a727-fa9d-4092-b54c-3325074b94d9]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d96f7e-c931-48e3-b29c-b94ad595a22a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b4ce0d-7050-467c-87fa-dfdb9dba1f5f]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk 1073741824" returned: 0 in 0.069s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b550a0a-9016-4c21-968c-c02fc0ca96f4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b644f2-f203-4e80-baba-2393040b7d66]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260]
Aug 16 15:18:46 user nova-compute[73091]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6, portal: 172.16.0.220,3260] successful.
Aug 16 15:18:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce05b162-febb-469c-93c9-cd2f60e1d11b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.495s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] <== disconnect_volume: return (497ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:18:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:18:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Deleting instance files /opt/stack/data/nova/instances/8e6d2c04-e78d-439f-8259-e3fae71840ba_del
Aug 16 15:18:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Deletion of /opt/stack/data/nova/instances/8e6d2c04-e78d-439f-8259-e3fae71840ba_del complete
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:18:47 user nova-compute[73091]: INFO nova.compute.manager [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Took 1.54 seconds to destroy the instance on the hypervisor.
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Cannot resize image /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'migration_context' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Ensure instance console log exists: /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Successfully created port: 4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-5dec35f2-d497-4f24-83d3-345f9ce96093 req-338bc97b-ba00-489e-96ca-7d5b962b7516 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5dec35f2-d497-4f24-83d3-345f9ce96093 req-338bc97b-ba00-489e-96ca-7d5b962b7516 service nova] Acquiring lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5dec35f2-d497-4f24-83d3-345f9ce96093 req-338bc97b-ba00-489e-96ca-7d5b962b7516 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5dec35f2-d497-4f24-83d3-345f9ce96093 req-338bc97b-ba00-489e-96ca-7d5b962b7516 service nova] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-5dec35f2-d497-4f24-83d3-345f9ce96093 req-338bc97b-ba00-489e-96ca-7d5b962b7516 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] No waiting events found dispatching network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:47 user nova-compute[73091]: WARNING nova.compute.manager [req-5dec35f2-d497-4f24-83d3-345f9ce96093 req-338bc97b-ba00-489e-96ca-7d5b962b7516 service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received unexpected event network-vif-plugged-49080ee5-1f91-48ce-a4f3-c17e08515a4c for instance with vm_state active and task_state deleting.
Aug 16 15:18:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Took 1.11 seconds to deallocate network for instance.
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Successfully updated port: 4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-changed-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Refreshing instance network info cache due to event network-changed-4c46ede2-2e38-4999-aa47-2c7f3a36f65f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance network_info: |[{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Refreshing network info cache for port 4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start _get_guest_xml network_info=[{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:18:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:18:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:18:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'pci_devices' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:18:49 user nova-compute[73091]:   <uuid>725361f9-395a-4a19-9900-bacbb4315b92</uuid>
Aug 16 15:18:49 user nova-compute[73091]:   <name>instance-00000024</name>
Aug 16 15:18:49 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:18:49 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:18:49 user nova-compute[73091]:   <metadata>
Aug 16 15:18:49 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:18:49 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:18:49 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-595386289</nova:name>
Aug 16 15:18:49 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:18:48</nova:creationTime>
Aug 16 15:18:49 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:18:49 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:18:49 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:18:49 user nova-compute[73091]:       <nova:owner>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:user uuid="4323609874c6400a986d1041316e8e78">tempest-AttachVolumeTestJSON-1875838463-project-member</nova:user>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:project uuid="2d9fa8ad962c43d4997806056d83f4a4">tempest-AttachVolumeTestJSON-1875838463</nova:project>
Aug 16 15:18:49 user nova-compute[73091]:       </nova:owner>
Aug 16 15:18:49 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:18:49 user nova-compute[73091]:       <nova:ports>
Aug 16 15:18:49 user nova-compute[73091]:         <nova:port uuid="4c46ede2-2e38-4999-aa47-2c7f3a36f65f">
Aug 16 15:18:49 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:18:49 user nova-compute[73091]:         </nova:port>
Aug 16 15:18:49 user nova-compute[73091]:       </nova:ports>
Aug 16 15:18:49 user nova-compute[73091]:     </nova:instance>
Aug 16 15:18:49 user nova-compute[73091]:   </metadata>
Aug 16 15:18:49 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:18:49 user nova-compute[73091]:     <system>
Aug 16 15:18:49 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:18:49 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:18:49 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:18:49 user nova-compute[73091]:       <entry name="serial">725361f9-395a-4a19-9900-bacbb4315b92</entry>
Aug 16 15:18:49 user nova-compute[73091]:       <entry name="uuid">725361f9-395a-4a19-9900-bacbb4315b92</entry>
Aug 16 15:18:49 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:18:49 user nova-compute[73091]:     </system>
Aug 16 15:18:49 user nova-compute[73091]:   </sysinfo>
Aug 16 15:18:49 user nova-compute[73091]:   <os>
Aug 16 15:18:49 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:18:49 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:18:49 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:18:49 user nova-compute[73091]:   </os>
Aug 16 15:18:49 user nova-compute[73091]:   <features>
Aug 16 15:18:49 user nova-compute[73091]:     <acpi/>
Aug 16 15:18:49 user nova-compute[73091]:     <apic/>
Aug 16 15:18:49 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:18:49 user nova-compute[73091]:   </features>
Aug 16 15:18:49 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:18:49 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:18:49 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:18:49 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:18:49 user nova-compute[73091]:   </clock>
Aug 16 15:18:49 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:18:49 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:18:49 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:18:49 user nova-compute[73091]:   </cpu>
Aug 16 15:18:49 user nova-compute[73091]:   <devices>
Aug 16 15:18:49 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:18:49 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:18:49 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk"/>
Aug 16 15:18:49 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:18:49 user nova-compute[73091]:     </disk>
Aug 16 15:18:49 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:18:49 user nova-compute[73091]:       <mac address="fa:16:3e:bd:6c:10"/>
Aug 16 15:18:49 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:18:49 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:18:49 user nova-compute[73091]:       <target dev="tap4c46ede2-2e"/>
Aug 16 15:18:49 user nova-compute[73091]:     </interface>
Aug 16 15:18:49 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:18:49 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/console.log" append="off"/>
Aug 16 15:18:49 user nova-compute[73091]:     </serial>
Aug 16 15:18:49 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:18:49 user nova-compute[73091]:     <video>
Aug 16 15:18:49 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:18:49 user nova-compute[73091]:     </video>
Aug 16 15:18:49 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:18:49 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:18:49 user nova-compute[73091]:     </rng>
Aug 16 15:18:49 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:18:49 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:18:49 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:18:49 user nova-compute[73091]:     </memballoon>
Aug 16 15:18:49 user nova-compute[73091]:   </devices>
Aug 16 15:18:49 user nova-compute[73091]: </domain>
Aug 16 15:18:49 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG os_vif [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c46ede2-2e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c46ede2-2e, col_values=(('external_ids', {'iface-id': '4c46ede2-2e38-4999-aa47-2c7f3a36f65f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:6c:10', 'vm-uuid': '725361f9-395a-4a19-9900-bacbb4315b92'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:49 user nova-compute[73091]: INFO os_vif [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e')
Aug 16 15:18:49 user nova-compute[73091]: INFO nova.compute.manager [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Deleting volume: 9c1f588d-a1b0-4a6f-90e9-4587b1bbdde6 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No VIF found with MAC fa:16:3e:bd:6c:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updated VIF entry in instance network info cache for port 4c46ede2-2e38-4999-aa47-2c7f3a36f65f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1b18b5a-f2aa-4284-b87c-094ccafd95d2 req-b1ebd0d9-e27a-4502-b1b4-c68135a595ec service nova] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:18:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:49 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Deleted allocations for instance 8e6d2c04-e78d-439f-8259-e3fae71840ba
Aug 16 15:18:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-46ac6d67-6c55-4fc5-8aad-c09af78272fa tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "8e6d2c04-e78d-439f-8259-e3fae71840ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.344s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-de43cd05-91e8-41e5-8c8f-6b78a5d1c973 req-fcf04b80-66c1-4c5a-8fcc-4cea1bb402fc service nova] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Received event network-vif-deleted-49080ee5-1f91-48ce-a4f3-c17e08515a4c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0330a962-4eda-48bd-af35-58e628fffe31 req-d3e4fc09-706b-470e-86f7-d6eab560123f service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0330a962-4eda-48bd-af35-58e628fffe31 req-d3e4fc09-706b-470e-86f7-d6eab560123f service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0330a962-4eda-48bd-af35-58e628fffe31 req-d3e4fc09-706b-470e-86f7-d6eab560123f service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0330a962-4eda-48bd-af35-58e628fffe31 req-d3e4fc09-706b-470e-86f7-d6eab560123f service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-0330a962-4eda-48bd-af35-58e628fffe31 req-d3e4fc09-706b-470e-86f7-d6eab560123f service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:50 user nova-compute[73091]: WARNING nova.compute.manager [req-0330a962-4eda-48bd-af35-58e628fffe31 req-d3e4fc09-706b-470e-86f7-d6eab560123f service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state building and task_state spawning.
Aug 16 15:18:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-8be9d15a-209a-45b6-a09d-0927d5bf06a1 req-cf889edf-9341-45db-a95d-a8c63a08b21e service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:18:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8be9d15a-209a-45b6-a09d-0927d5bf06a1 req-cf889edf-9341-45db-a95d-a8c63a08b21e service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:18:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8be9d15a-209a-45b6-a09d-0927d5bf06a1 req-cf889edf-9341-45db-a95d-a8c63a08b21e service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:18:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8be9d15a-209a-45b6-a09d-0927d5bf06a1 req-cf889edf-9341-45db-a95d-a8c63a08b21e service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-8be9d15a-209a-45b6-a09d-0927d5bf06a1 req-cf889edf-9341-45db-a95d-a8c63a08b21e service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:18:52 user nova-compute[73091]: WARNING nova.compute.manager [req-8be9d15a-209a-45b6-a09d-0927d5bf06a1 req-cf889edf-9341-45db-a95d-a8c63a08b21e service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state building and task_state spawning.
Aug 16 15:18:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199132.997581, 725361f9-395a-4a19-9900-bacbb4315b92 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Resumed (Lifecycle Event)
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance spawned successfully.
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199132.9996722, 725361f9-395a-4a19-9900-bacbb4315b92 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Started (Lifecycle Event)
Aug 16 15:18:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Took 6.83 seconds to spawn the instance on the hypervisor.
Aug 16 15:18:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:18:53 user nova-compute[73091]: INFO nova.compute.manager [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Took 7.67 seconds to build instance.
Aug 16 15:18:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-765bc334-f63c-469d-af97-5ee2f2611300 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.792s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:18:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:18:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:01 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199126.331774, 8e6d2c04-e78d-439f-8259-e3fae71840ba => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:19:01 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] VM Stopped (Lifecycle Event)
Aug 16 15:19:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc2dcc15-e774-4848-a5e9-1445d709bd0c None None] [instance: 8e6d2c04-e78d-439f-8259-e3fae71840ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:03 user nova-compute[73091]: INFO nova.compute.manager [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Terminating instance
Aug 16 15:19:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-500f00de-a881-498d-8819-777c3b24f181 req-1b26b41b-42cb-4312-9d8e-ea5dc25e2eb1 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-500f00de-a881-498d-8819-777c3b24f181 req-1b26b41b-42cb-4312-9d8e-ea5dc25e2eb1 service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-500f00de-a881-498d-8819-777c3b24f181 req-1b26b41b-42cb-4312-9d8e-ea5dc25e2eb1 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-500f00de-a881-498d-8819-777c3b24f181 req-1b26b41b-42cb-4312-9d8e-ea5dc25e2eb1 service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-500f00de-a881-498d-8819-777c3b24f181 req-1b26b41b-42cb-4312-9d8e-ea5dc25e2eb1 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-500f00de-a881-498d-8819-777c3b24f181 req-1b26b41b-42cb-4312-9d8e-ea5dc25e2eb1 service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-unplugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Instance destroyed successfully.
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'resources' on Instance uuid dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777760291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777760291',id=13,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:05:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-glbmaeaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:07:02Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "address": "fa:16:3e:0b:54:a1", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c20df6-0c", "ovs_interfaceid": "18c20df6-0c75-4bbf-b421-3d248a2e0d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_vif [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18c20df6-0c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:19:04 user nova-compute[73091]: INFO os_vif [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:54:a1,bridge_name='br-int',has_traffic_filtering=True,id=18c20df6-0c75-4bbf-b421-3d248a2e0d38,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c20df6-0c')
Aug 16 15:19:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdJYDqCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:19:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6abb968-9f09-4491-b036-d8ff82ad04d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[df512d4d-2cca-49ab-83d0-632cbd4d78b7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:19:04 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:04 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)
Aug 16 15:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b (non-flash)
Aug 16 15:19:04 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:04 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)
Aug 16 15:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c532320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b'): ({'sdg'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Removing single pathed devices sdg {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[33101c40-9fd5-4eee-ab5b-e35ef7e2cec8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[143bb5fd-5203-4093-8f30-7779da9c986a]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Flushing IO for device /dev/sdg {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7508e-ca3a-4f6a-ad9d-b2dd2438618b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ab154d-d93e-49d4-9369-0f9fc1a7e238]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] SCSI volumes sdg have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd9ecb-3be1-4bec-85f3-ea6b735c0f4f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c25fc5f-8b9b-40a7-a12f-0bf0acf680a2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260]
Aug 16 15:19:05 user nova-compute[73091]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b, portal: 172.16.0.220,3260] successful.
Aug 16 15:19:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a07ad26-a7e6-4d33-85dc-eae180effd2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ae668-69d0-42bc-8eaf-28c842480b5d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] <== disconnect_volume: return (328ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:19:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Deleting instance files /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232_del
Aug 16 15:19:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Deletion of /opt/stack/data/nova/instances/dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232_del complete
Aug 16 15:19:05 user nova-compute[73091]: INFO nova.compute.manager [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 16 15:19:05 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:19:05 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:05 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Took 0.68 seconds to deallocate network for instance.
Aug 16 15:19:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] Acquiring lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] No waiting events found dispatching network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:06 user nova-compute[73091]: WARNING nova.compute.manager [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received unexpected event network-vif-plugged-18c20df6-0c75-4bbf-b421-3d248a2e0d38 for instance with vm_state active and task_state deleting.
Aug 16 15:19:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5d80a33-6c23-413d-8ba5-32cb2cfdaaa8 req-37a140d0-8d4b-4c12-b9e6-faf5e8a52f9b service nova] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Received event network-vif-deleted-18c20df6-0c75-4bbf-b421-3d248a2e0d38 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:06 user nova-compute[73091]: INFO nova.compute.manager [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Took 0.89 seconds to detach 1 volumes for instance.
Aug 16 15:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'flavor' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:07 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Deleted allocations for instance dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-750246ac-048c-4504-bba7-0174d680ab98 tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.358s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:07 user nova-compute[73091]: INFO nova.compute.manager [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Attaching volume 6a7f7a1e-c369-4749-93bf-50220d9abbf3 to /dev/vdb
Aug 16 15:19:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd6246e-3e5f-47da-9c77-0b83f06d9259]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66831ee-129c-4a4c-91ce-81551baaa0ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0209956-eb5e-4c68-b3e1-b76fca3c2826]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7df8115-6b1c-4fbc-863c-a33bd3d8273a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:19:07 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:19:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db201e9-77c2-49db-bd3c-a7e8a6f07db3]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:19:07 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating existing volume attachment record: 5b620ea6-0e3d-43ab-b5e4-02efac3da443 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:19:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:19:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=25.215106964111328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance daf4f67c-fc4a-4386-8347-07c350412126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b6791c34-3d16-4317-b1ca-f698edda9780 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e1867285-e33a-4b24-8f9e-96886a018a90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance ba8ec8b1-1837-45db-aa6b-76146255a8fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:19:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [{"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-e1867285-e33a-4b24-8f9e-96886a018a90" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHvNPneM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:19:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:19:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:19:19 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbabae-bfbc-40b2-a44c-4689ff82d967]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:19:19 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4546ac-3d36-4f5e-b240-6297f492b767]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3] added
Aug 16 15:19:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd9dc2-c9a9-46d2-ae25-2b5f5afe29d3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa705dbc-8433-4ef9-b5af-1d9c7e376249]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHvNPneM {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHvNPneM" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1ad5be-da1a-4cf3-9ce3-f21a2cd95673]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHvNPneM'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb08b90-a9c7-4a3c-af2e-e0039fdd442c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1579f0bc-9971-45a3-bf23-387676573277]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedb05d9-974b-45a2-99c5-f6b4b2b697d8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedb05d9-974b-45a2-99c5-f6b4b2b697d8 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedb05d9-974b-45a2-99c5-f6b4b2b697d8 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff7f0e-c8eb-4761-b15b-f991a4ee0e42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260]
Aug 16 15:19:19 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260] successful.
Aug 16 15:19:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a4f760-1f8a-49c2-b5e2-0aba6520d802]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78238f64-e78f-4071-b48d-addd13fa30cd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedb05d9-974b-45a2-99c5-f6b4b2b697d8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedb05d9-974b-45a2-99c5-f6b4b2b697d8 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8a33de0-c440-4ff6-8123-d6b8ab7f2216 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedb05d9-974b-45a2-99c5-f6b4b2b697d8 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:19:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f049c-1640-46c7-808d-97046b1b1991]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHvNPneM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199144.7183204, dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:19:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] VM Stopped (Lifecycle Event)
Aug 16 15:19:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-78cafa6a-71e2-4bb4-950f-1bacd73db83e None None] [instance: dbbeedf7-1a8c-4d6f-a046-bcaa2fb00232] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23663323137303536', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663323137303536', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'flavor' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:19:20 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:19:20 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:19:20 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:19:20 user nova-compute[73091]:   <serial>6a7f7a1e-c369-4749-93bf-50220d9abbf3</serial>
Aug 16 15:19:20 user nova-compute[73091]: </disk>
Aug 16 15:19:20 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:19:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] No VIF found with MAC fa:16:3e:af:2e:1c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:19:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-20d28d98-911f-462c-842a-5eead32a4f71 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.653s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing instance network info cache due to event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:19:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:19:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:19:23 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:19:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updated VIF entry in instance network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:19:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d6738d9-a6e5-4959-8264-dd2e731422f5 req-3e45fec2-8aa7-442d-bdd6-1a4907ece570 service nova] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:19:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing instance network info cache due to event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:19:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:19:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:19:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updated VIF entry in instance network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d397599-ce23-4020-aa59-b58c4edb9e85 req-178b7517-78fa-49c0-ac31-d502d61f6cb4 service nova] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:26 user nova-compute[73091]: INFO nova.compute.manager [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Rebooting instance
Aug 16 15:19:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:19:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:19:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:19:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-92c5601f-b66c-4b53-9573-be4acc9457d7 req-3e4eb1ea-1fe6-46a4-b3a4-b48f10b52404 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-unplugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-92c5601f-b66c-4b53-9573-be4acc9457d7 req-3e4eb1ea-1fe6-46a4-b3a4-b48f10b52404 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-92c5601f-b66c-4b53-9573-be4acc9457d7 req-3e4eb1ea-1fe6-46a4-b3a4-b48f10b52404 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-92c5601f-b66c-4b53-9573-be4acc9457d7 req-3e4eb1ea-1fe6-46a4-b3a4-b48f10b52404 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-92c5601f-b66c-4b53-9573-be4acc9457d7 req-3e4eb1ea-1fe6-46a4-b3a4-b48f10b52404 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-unplugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:29 user nova-compute[73091]: WARNING nova.compute.manager [req-92c5601f-b66c-4b53-9573-be4acc9457d7 req-3e4eb1ea-1fe6-46a4-b3a4-b48f10b52404 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-unplugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state active and task_state reboot_started.
Aug 16 15:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance shutdown successfully.
Aug 16 15:19:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:19:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6802135-2d1a-45e4-8eea-c7966fb4cc0d req-2370e73b-3076-4098-a2a8-4df323115138 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6802135-2d1a-45e4-8eea-c7966fb4cc0d req-2370e73b-3076-4098-a2a8-4df323115138 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6802135-2d1a-45e4-8eea-c7966fb4cc0d req-2370e73b-3076-4098-a2a8-4df323115138 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6802135-2d1a-45e4-8eea-c7966fb4cc0d req-2370e73b-3076-4098-a2a8-4df323115138 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6802135-2d1a-45e4-8eea-c7966fb4cc0d req-2370e73b-3076-4098-a2a8-4df323115138 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:31 user nova-compute[73091]: WARNING nova.compute.manager [req-f6802135-2d1a-45e4-8eea-c7966fb4cc0d req-2370e73b-3076-4098-a2a8-4df323115138 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state active and task_state reboot_started.
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:31 user nova-compute[73091]: INFO nova.compute.manager [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Terminating instance
Aug 16 15:19:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-93a5ca06-61cd-49a7-96c2-0b785cef2d3f req-84462f14-2eb4-4499-a7e8-a3946cf1f921 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93a5ca06-61cd-49a7-96c2-0b785cef2d3f req-84462f14-2eb4-4499-a7e8-a3946cf1f921 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93a5ca06-61cd-49a7-96c2-0b785cef2d3f req-84462f14-2eb4-4499-a7e8-a3946cf1f921 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93a5ca06-61cd-49a7-96c2-0b785cef2d3f req-84462f14-2eb4-4499-a7e8-a3946cf1f921 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-93a5ca06-61cd-49a7-96c2-0b785cef2d3f req-84462f14-2eb4-4499-a7e8-a3946cf1f921 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-93a5ca06-61cd-49a7-96c2-0b785cef2d3f req-84462f14-2eb4-4499-a7e8-a3946cf1f921 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Instance destroyed successfully.
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lazy-loading 'resources' on Instance uuid e1867285-e33a-4b24-8f9e-96886a018a90 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937008942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937008942',id=33,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/DBgrLgwI4zaI4rWEC7+z1vkl35C8R5oYUvNcjwjH/UMTG020zjicREFf371y90owyPLCU9gC8skIVbMioQyFgHe1GnSQeADg1+pqGObzKo3NYGuX/1fl9pGFsZ7HAA==',key_name='tempest-keypair-1222551489',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c198a130ace46eca27de708de492ef7',ramdisk_id='',reservation_id='r-yytgy2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1996332630',owner_user_name='tempest-AttachVolumeShelveTestJSON-1996332630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f6775ee1ca44360920397fd8bbf2899',uuid=e1867285-e33a-4b24-8f9e-96886a018a90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converting VIF {"id": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "address": "fa:16:3e:3e:54:00", "network": {"id": "18199685-49bb-4792-ab59-e070ba190c3c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1622291246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c198a130ace46eca27de708de492ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c487e54-2a", "ovs_interfaceid": "7c487e54-2a45-431e-8ac2-0d416e43db0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG os_vif [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c487e54-2a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:19:32 user nova-compute[73091]: INFO os_vif [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:54:00,bridge_name='br-int',has_traffic_filtering=True,id=7c487e54-2a45-431e-8ac2-0d416e43db0d,network=Network(18199685-49bb-4792-ab59-e070ba190c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c487e54-2a')
Aug 16 15:19:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Deleting instance files /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90_del
Aug 16 15:19:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Deletion of /opt/stack/data/nova/instances/e1867285-e33a-4b24-8f9e-96886a018a90_del complete
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: INFO nova.compute.manager [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 16 15:19:32 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb9a0d2c-5799-4970-9296-244e30ac75d7 req-249adc11-5e9b-4946-9cc8-5d21214cde83 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-deleted-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:33 user nova-compute[73091]: INFO nova.compute.manager [req-eb9a0d2c-5799-4970-9296-244e30ac75d7 req-249adc11-5e9b-4946-9cc8-5d21214cde83 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Neutron deleted interface 7c487e54-2a45-431e-8ac2-0d416e43db0d; detaching it from the instance and deleting it from the info cache
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb9a0d2c-5799-4970-9296-244e30ac75d7 req-249adc11-5e9b-4946-9cc8-5d21214cde83 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:33 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Took 0.92 seconds to deallocate network for instance.
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb9a0d2c-5799-4970-9296-244e30ac75d7 req-249adc11-5e9b-4946-9cc8-5d21214cde83 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Detach interface failed, port_id=7c487e54-2a45-431e-8ac2-0d416e43db0d, reason: Instance e1867285-e33a-4b24-8f9e-96886a018a90 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:33 user nova-compute[73091]: WARNING nova.compute.manager [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state active and task_state reboot_started.
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:33 user nova-compute[73091]: WARNING nova.compute.manager [req-ce74823c-4c05-4eec-ac2b-5fefe7afe59b req-10dd67a5-983e-4521-b684-08292736b549 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state active and task_state reboot_started.
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:33 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Deleted allocations for instance e1867285-e33a-4b24-8f9e-96886a018a90
Aug 16 15:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a7bb9762-7ec5-4e82-9d40-a3ab795431ee tempest-AttachVolumeShelveTestJSON-1996332630 tempest-AttachVolumeShelveTestJSON-1996332630-project-member] Lock "e1867285-e33a-4b24-8f9e-96886a018a90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:34 user nova-compute[73091]: WARNING nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state deleted and task_state None.
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:34 user nova-compute[73091]: WARNING nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state deleted and task_state None.
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:34 user nova-compute[73091]: WARNING nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state deleted and task_state None.
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:34 user nova-compute[73091]: WARNING nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-unplugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state deleted and task_state None.
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Acquiring lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] Lock "e1867285-e33a-4b24-8f9e-96886a018a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] No waiting events found dispatching network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:34 user nova-compute[73091]: WARNING nova.compute.manager [req-15ba51bb-4952-4261-8156-8c3a2ec5e389 req-2fda2a9d-70ef-4100-a4f3-1e2208ccb585 service nova] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Received unexpected event network-vif-plugged-7c487e54-2a45-431e-8ac2-0d416e43db0d for instance with vm_state deleted and task_state None.
Aug 16 15:19:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance running successfully.
Aug 16 15:19:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance soft rebooted successfully.
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for 4962ad4c-43c9-47a0-b26c-991cd8a37cac due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199174.3087544, 4962ad4c-43c9-47a0-b26c-991cd8a37cac => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:19:34 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] VM Resumed (Lifecycle Event)
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:19:34 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199174.3143587, 4962ad4c-43c9-47a0-b26c-991cd8a37cac => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:19:34 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] VM Started (Lifecycle Event)
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c44f3b04-b669-4300-91be-20ef7e16c85c tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.905s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:44 user nova-compute[73091]: INFO nova.compute.manager [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Terminating instance
Aug 16 15:19:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-918a585b-706b-4b92-bf85-c3c3bb978a4e req-44cd7417-b8ce-4ad3-b6ee-ca83b6739734 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-vif-unplugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-918a585b-706b-4b92-bf85-c3c3bb978a4e req-44cd7417-b8ce-4ad3-b6ee-ca83b6739734 service nova] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-918a585b-706b-4b92-bf85-c3c3bb978a4e req-44cd7417-b8ce-4ad3-b6ee-ca83b6739734 service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-918a585b-706b-4b92-bf85-c3c3bb978a4e req-44cd7417-b8ce-4ad3-b6ee-ca83b6739734 service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-918a585b-706b-4b92-bf85-c3c3bb978a4e req-44cd7417-b8ce-4ad3-b6ee-ca83b6739734 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] No waiting events found dispatching network-vif-unplugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-918a585b-706b-4b92-bf85-c3c3bb978a4e req-44cd7417-b8ce-4ad3-b6ee-ca83b6739734 service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-vif-unplugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:19:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Instance destroyed successfully.
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lazy-loading 'resources' on Instance uuid b6791c34-3d16-4317-b1ca-f698edda9780 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1488066308',display_name='tempest-ServerActionsTestOtherA-server-1488066308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1488066308',id=6,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQS8cHQJSnnRZnAhWIynmn4vzNjMvwVz0LWpWnjAJEPOfcE/SynKOlJu4E0CNCqrubGJAssF53uN9se/mRcsDuItTYf+Ua5VoJUJJpshDaEd0IMOAdpK2TnKydDy8QhA==',key_name='tempest-keypair-618718909',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99af3ee8a3c64c50a44aa98bcdd05222',ramdisk_id='',reservation_id='r-zjc71q53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-305054434',owner_user_name='tempest-ServerActionsTestOtherA-305054434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bf98e80707482a9c43719d7a56004a',uuid=b6791c34-3d16-4317-b1ca-f698edda9780,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converting VIF {"id": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "address": "fa:16:3e:89:5b:a6", "network": {"id": "62d5daec-b9d3-4714-b18b-703304c0a611", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-524166992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99af3ee8a3c64c50a44aa98bcdd05222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c5eaab-2d", "ovs_interfaceid": "b2c5eaab-2de0-4764-9f7e-befb33ef9e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG os_vif [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2c5eaab-2d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:19:45 user nova-compute[73091]: INFO os_vif [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=b2c5eaab-2de0-4764-9f7e-befb33ef9e7c,network=Network(62d5daec-b9d3-4714-b18b-703304c0a611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c5eaab-2d')
Aug 16 15:19:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Deleting instance files /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780_del
Aug 16 15:19:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Deletion of /opt/stack/data/nova/instances/b6791c34-3d16-4317-b1ca-f698edda9780_del complete
Aug 16 15:19:45 user nova-compute[73091]: INFO nova.compute.manager [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 15:19:45 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:19:45 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:19:46 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:46 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Took 0.54 seconds to deallocate network for instance.
Aug 16 15:19:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbac9e6f-abbe-4473-ab96-26b8a104dace req-6ef87aab-2f74-4ceb-bb9f-32ad5855ee4e service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-vif-deleted-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:19:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:46 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Deleted allocations for instance b6791c34-3d16-4317-b1ca-f698edda9780
Aug 16 15:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5cc1fb9-a5ad-44ae-b25b-2a448553f3a4 tempest-ServerActionsTestOtherA-305054434 tempest-ServerActionsTestOtherA-305054434-project-member] Lock "b6791c34-3d16-4317-b1ca-f698edda9780" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-e00ae535-21dd-4763-a533-cf8d6ef06888 req-989339b0-4a88-4500-928b-07d5da2636fa service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received event network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e00ae535-21dd-4763-a533-cf8d6ef06888 req-989339b0-4a88-4500-928b-07d5da2636fa service nova] Acquiring lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e00ae535-21dd-4763-a533-cf8d6ef06888 req-989339b0-4a88-4500-928b-07d5da2636fa service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e00ae535-21dd-4763-a533-cf8d6ef06888 req-989339b0-4a88-4500-928b-07d5da2636fa service nova] Lock "b6791c34-3d16-4317-b1ca-f698edda9780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-e00ae535-21dd-4763-a533-cf8d6ef06888 req-989339b0-4a88-4500-928b-07d5da2636fa service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] No waiting events found dispatching network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:47 user nova-compute[73091]: WARNING nova.compute.manager [req-e00ae535-21dd-4763-a533-cf8d6ef06888 req-989339b0-4a88-4500-928b-07d5da2636fa service nova] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Received unexpected event network-vif-plugged-b2c5eaab-2de0-4764-9f7e-befb33ef9e7c for instance with vm_state deleted and task_state None.
Aug 16 15:19:47 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199172.4148774, e1867285-e33a-4b24-8f9e-96886a018a90 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:19:47 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] VM Stopped (Lifecycle Event)
Aug 16 15:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b18a8213-f564-4672-bf84-f59b7451b28a None None] [instance: e1867285-e33a-4b24-8f9e-96886a018a90] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:19:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:52 user nova-compute[73091]: INFO nova.compute.manager [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Terminating instance
Aug 16 15:19:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-075689a8-0fd0-46bc-b56e-4dcf9c32d773 req-ecf7ba02-d2bb-45cd-a801-da1eddf55925 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-vif-unplugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-075689a8-0fd0-46bc-b56e-4dcf9c32d773 req-ecf7ba02-d2bb-45cd-a801-da1eddf55925 service nova] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-075689a8-0fd0-46bc-b56e-4dcf9c32d773 req-ecf7ba02-d2bb-45cd-a801-da1eddf55925 service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-075689a8-0fd0-46bc-b56e-4dcf9c32d773 req-ecf7ba02-d2bb-45cd-a801-da1eddf55925 service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-075689a8-0fd0-46bc-b56e-4dcf9c32d773 req-ecf7ba02-d2bb-45cd-a801-da1eddf55925 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] No waiting events found dispatching network-vif-unplugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-075689a8-0fd0-46bc-b56e-4dcf9c32d773 req-ecf7ba02-d2bb-45cd-a801-da1eddf55925 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-vif-unplugged-c5ced08d-f28d-4bdd-952d-288a7771b400 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Instance destroyed successfully.
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'resources' on Instance uuid ba8ec8b1-1837-45db-aa6b-76146255a8fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-456316243',display_name='tempest-TestVolumeBootPattern-server-456316243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-456316243',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-kws07ltx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:18:25Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=ba8ec8b1-1837-45db-aa6b-76146255a8fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "c5ced08d-f28d-4bdd-952d-288a7771b400", "address": "fa:16:3e:9c:8e:fa", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ced08d-f2", "ovs_interfaceid": "c5ced08d-f28d-4bdd-952d-288a7771b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_vif [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5ced08d-f2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:19:53 user nova-compute[73091]: INFO os_vif [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8e:fa,bridge_name='br-int',has_traffic_filtering=True,id=c5ced08d-f28d-4bdd-952d-288a7771b400,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ced08d-f2')
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmfhHWdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:19:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0f8cd-7e8c-4817-a101-0706db562b7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61adf0a3-284e-4d84-9764-d3a769863891]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:53 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 (non-flash)
Aug 16 15:19:53 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c533250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446d43e-d69d-43e7-af79-6707590177fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36690671-84b9-4d4d-b662-1b586203e5a0]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361fdad-709c-48d7-9b40-9a2c2097698d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b7a76-fa49-4cb2-8158-1e5aa9d25557]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23366643566383537', '/dev/disk/by-id/scsi-1SCST_BIOc2c8a759-3fd5f857fc794605', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c2c8a759') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c22c8-fecd-4ab5-8c73-a9c917636b44]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa9b5d-d776-4773-bfe6-aa32a685a6c3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe270a1-a27c-49e8-b7f2-8355a4e334ab]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260]
Aug 16 15:19:53 user nova-compute[73091]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3, portal: 172.16.0.220,3260] successful.
Aug 16 15:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9b9de-a84b-4897-860d-78decac806a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a51448-5266-4f9e-af09-5dc46211ab15]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== disconnect_volume: return (270ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:19:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Deleting instance files /opt/stack/data/nova/instances/ba8ec8b1-1837-45db-aa6b-76146255a8fe_del
Aug 16 15:19:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Deletion of /opt/stack/data/nova/instances/ba8ec8b1-1837-45db-aa6b-76146255a8fe_del complete
Aug 16 15:19:53 user nova-compute[73091]: INFO nova.compute.manager [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 16 15:19:53 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:19:53 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:19:54 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:54 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Took 0.53 seconds to deallocate network for instance.
Aug 16 15:19:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-d5102b55-9d2d-4dca-848f-fe6aa031591d req-1234f8ca-d7db-427f-b752-3640afa000cc service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-vif-deleted-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "daf4f67c-fc4a-4386-8347-07c350412126" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:54 user nova-compute[73091]: INFO nova.compute.manager [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Terminating instance
Aug 16 15:19:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-aaeabb45-603e-4ba3-94cb-9356f21df8de req-e0945328-8414-462f-8ebe-1bd63ed590c3 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received event network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aaeabb45-603e-4ba3-94cb-9356f21df8de req-e0945328-8414-462f-8ebe-1bd63ed590c3 service nova] Acquiring lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aaeabb45-603e-4ba3-94cb-9356f21df8de req-e0945328-8414-462f-8ebe-1bd63ed590c3 service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aaeabb45-603e-4ba3-94cb-9356f21df8de req-e0945328-8414-462f-8ebe-1bd63ed590c3 service nova] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-aaeabb45-603e-4ba3-94cb-9356f21df8de req-e0945328-8414-462f-8ebe-1bd63ed590c3 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] No waiting events found dispatching network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:55 user nova-compute[73091]: WARNING nova.compute.manager [req-aaeabb45-603e-4ba3-94cb-9356f21df8de req-e0945328-8414-462f-8ebe-1bd63ed590c3 service nova] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Received unexpected event network-vif-plugged-c5ced08d-f28d-4bdd-952d-288a7771b400 for instance with vm_state active and task_state deleting.
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:55 user nova-compute[73091]: INFO nova.compute.manager [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Took 0.79 seconds to detach 1 volumes for instance.
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Deleting volume: 78c9b9de-a84b-4897-860d-78decac806a3 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-d812216c-2c12-45dc-96f5-a6a92656adb1 req-c91b0cbd-adc5-4e8e-b3e4-2dde7a6048d1 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-vif-unplugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d812216c-2c12-45dc-96f5-a6a92656adb1 req-c91b0cbd-adc5-4e8e-b3e4-2dde7a6048d1 service nova] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d812216c-2c12-45dc-96f5-a6a92656adb1 req-c91b0cbd-adc5-4e8e-b3e4-2dde7a6048d1 service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d812216c-2c12-45dc-96f5-a6a92656adb1 req-c91b0cbd-adc5-4e8e-b3e4-2dde7a6048d1 service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-d812216c-2c12-45dc-96f5-a6a92656adb1 req-c91b0cbd-adc5-4e8e-b3e4-2dde7a6048d1 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] No waiting events found dispatching network-vif-unplugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-d812216c-2c12-45dc-96f5-a6a92656adb1 req-c91b0cbd-adc5-4e8e-b3e4-2dde7a6048d1 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-vif-unplugged-ca5b31b7-71d4-4945-9788-c04246e29539 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:55 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Deleted allocations for instance ba8ec8b1-1837-45db-aa6b-76146255a8fe
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd9039ee-463f-4a64-a2ac-6bdc21a03807 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "ba8ec8b1-1837-45db-aa6b-76146255a8fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Instance destroyed successfully.
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lazy-loading 'resources' on Instance uuid daf4f67c-fc4a-4386-8347-07c350412126 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2058445633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2058445633',id=1,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d07f3079144a59f93086e00017115',ramdisk_id='',reservation_id='r-v5tzy4zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-909556237',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:02:10Z,user_data=None,user_id='c0243ed66e484f6a820421b1f69ece02',uuid=daf4f67c-fc4a-4386-8347-07c350412126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converting VIF {"id": "ca5b31b7-71d4-4945-9788-c04246e29539", "address": "fa:16:3e:ac:ae:14", "network": {"id": "8ab42964-4cd4-498a-aa85-a696ac56d827", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1783625121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d07f3079144a59f93086e00017115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5b31b7-71", "ovs_interfaceid": "ca5b31b7-71d4-4945-9788-c04246e29539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG os_vif [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca5b31b7-71, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:19:55 user nova-compute[73091]: INFO os_vif [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=ca5b31b7-71d4-4945-9788-c04246e29539,network=Network(8ab42964-4cd4-498a-aa85-a696ac56d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5b31b7-71')
Aug 16 15:19:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Deleting instance files /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126_del
Aug 16 15:19:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Deletion of /opt/stack/data/nova/instances/daf4f67c-fc4a-4386-8347-07c350412126_del complete
Aug 16 15:19:55 user nova-compute[73091]: INFO nova.compute.manager [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 15:19:55 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:19:55 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:19:56 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:19:56 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Took 0.45 seconds to deallocate network for instance.
Aug 16 15:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1b3e0fb-535d-46c3-9820-94c596fc9d1e req-5760e203-1af2-42d2-9aa9-c29066f675a8 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-vif-deleted-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:56 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:19:56 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:56 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Deleted allocations for instance daf4f67c-fc4a-4386-8347-07c350412126
Aug 16 15:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21e0c37e-81f5-4c05-b690-2adef17d431d tempest-ServerBootFromVolumeStableRescueTest-909556237 tempest-ServerBootFromVolumeStableRescueTest-909556237-project-member] Lock "daf4f67c-fc4a-4386-8347-07c350412126" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4c65cda-a082-4b55-80e0-f71a8e29614c req-32bff1ea-42c7-4170-bafa-c1ad4f806696 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received event network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4c65cda-a082-4b55-80e0-f71a8e29614c req-32bff1ea-42c7-4170-bafa-c1ad4f806696 service nova] Acquiring lock "daf4f67c-fc4a-4386-8347-07c350412126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4c65cda-a082-4b55-80e0-f71a8e29614c req-32bff1ea-42c7-4170-bafa-c1ad4f806696 service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4c65cda-a082-4b55-80e0-f71a8e29614c req-32bff1ea-42c7-4170-bafa-c1ad4f806696 service nova] Lock "daf4f67c-fc4a-4386-8347-07c350412126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:19:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4c65cda-a082-4b55-80e0-f71a8e29614c req-32bff1ea-42c7-4170-bafa-c1ad4f806696 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] No waiting events found dispatching network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:19:57 user nova-compute[73091]: WARNING nova.compute.manager [req-e4c65cda-a082-4b55-80e0-f71a8e29614c req-32bff1ea-42c7-4170-bafa-c1ad4f806696 service nova] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Received unexpected event network-vif-plugged-ca5b31b7-71d4-4945-9788-c04246e29539 for instance with vm_state deleted and task_state None.
Aug 16 15:19:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:00 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199185.6592243, b6791c34-3d16-4317-b1ca-f698edda9780 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:20:00 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] VM Stopped (Lifecycle Event)
Aug 16 15:20:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2f407c87-9cb4-4302-aa24-b86d78ed3c5a None None] [instance: b6791c34-3d16-4317-b1ca-f698edda9780] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:20:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:08 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199193.47626, ba8ec8b1-1837-45db-aa6b-76146255a8fe => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:20:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] VM Stopped (Lifecycle Event)
Aug 16 15:20:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-74a790c7-5772-452d-80e3-75b2e8a1ff1c None None] [instance: ba8ec8b1-1837-45db-aa6b-76146255a8fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199195.7480395, daf4f67c-fc4a-4386-8347-07c350412126 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:20:10 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: daf4f67c-fc4a-4386-8347-07c350412126] VM Stopped (Lifecycle Event)
Aug 16 15:20:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-97584739-60a1-4ccb-8898-84c11658d3bc None None] [instance: daf4f67c-fc4a-4386-8347-07c350412126] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:20:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:20:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8357MB free_disk=25.382713317871094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:20:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:20:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:20:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:20:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:20:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:20:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-changed-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:20:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Refreshing instance network info cache due to event network-changed-4c46ede2-2e38-4999-aa47-2c7f3a36f65f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:20:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:20:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:20:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Refreshing network info cache for port 4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:20:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updated VIF entry in instance network info cache for port 4c46ede2-2e38-4999-aa47-2c7f3a36f65f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:20:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:20:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2cd95e6e-f728-448d-954b-abee5c15b450 req-10252ae1-6d9e-4950-b9d1-3a4a45d206e9 service nova] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:20:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:20:42 user nova-compute[73091]: INFO nova.compute.manager [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Attaching volume 366767b6-4587-45a5-89a8-3d2f7455f658 to /dev/vdb
Aug 16 15:20:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c880aa-70fb-4ac2-a684-cbf98e598549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25b5fc2-4662-4ded-99a4-f3092aa9638a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e91a6-11fc-4d88-82e8-8ecc0d8e877b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f50d21e-91f3-4e78-a38e-c7ab07c197a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:20:43 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:20:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bac9e3-a0f1-423c-8dda-c560ee5bbc52]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating existing volume attachment record: b2330261-6c65-450b-90a0-868f3c10fba1 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:20:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:20:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:20:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:20:55 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e227c-f92f-4e81-98d8-a5cdf50d160c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:20:55 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ed0aa-ac89-4404-bc54-f46ea55bd8b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658] added
Aug 16 15:20:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69a4c5a-4912-46b9-9cf3-199c37e32c68]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4094e2-5f68-43d8-ab79-9fb29e96cc68]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAOEMbDz {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAOEMbDz" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222c014-1e6e-49e1-afa8-4abceced44b4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZAOEMbDz'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbac9d2-7217-4634-b9e4-a5c3f3aea7f7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b12e86-5a86-4553-999f-7b45fff499e3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:20:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:20:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a163b1-df05-4f05-9bde-bc5e6cb23e6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]
Aug 16 15:20:55 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.
Aug 16 15:20:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76039b3-c1aa-417a-a7ce-4ce2a9ddd4d2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0b4c1e-3361-4352-8c1c-bbb4339f3b9b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:20:55 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:20:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:20:55 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:20:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3317e609-ae39-4061-8dd8-1563411d3091]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26638313330393630', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638313330393630', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:20:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:20:56 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:20:56 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:20:56 user nova-compute[73091]:   <serial>366767b6-4587-45a5-89a8-3d2f7455f658</serial>
Aug 16 15:20:56 user nova-compute[73091]: </disk>
Aug 16 15:20:56 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:20:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No VIF found with MAC fa:16:3e:bd:6c:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:20:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-adae1fa3-54cc-43ea-98bd-fa1a93902511 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.289s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73091) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ae96501-2c19-471d-81c0-5026675ba4b6 req-e16d3725-81c2-4be9-8a25-76660159a2e5 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ae96501-2c19-471d-81c0-5026675ba4b6 req-e16d3725-81c2-4be9-8a25-76660159a2e5 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ae96501-2c19-471d-81c0-5026675ba4b6 req-e16d3725-81c2-4be9-8a25-76660159a2e5 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ae96501-2c19-471d-81c0-5026675ba4b6 req-e16d3725-81c2-4be9-8a25-76660159a2e5 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:20:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ae96501-2c19-471d-81c0-5026675ba4b6 req-e16d3725-81c2-4be9-8a25-76660159a2e5 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:20:58 user nova-compute[73091]: WARNING nova.compute.manager [req-9ae96501-2c19-471d-81c0-5026675ba4b6 req-e16d3725-81c2-4be9-8a25-76660159a2e5 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state active and task_state powering-off.
Aug 16 15:20:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance destroyed successfully.
Aug 16 15:20:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:20:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2db5216e-4ab4-4e69-ba31-70230a49a7ab tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.011s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:20:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-7f08340f-9267-4764-8c00-826ad9fe215a req-0c1d5c52-e456-4cc3-9ecf-0e5f92868a92 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7f08340f-9267-4764-8c00-826ad9fe215a req-0c1d5c52-e456-4cc3-9ecf-0e5f92868a92 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7f08340f-9267-4764-8c00-826ad9fe215a req-0c1d5c52-e456-4cc3-9ecf-0e5f92868a92 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7f08340f-9267-4764-8c00-826ad9fe215a req-0c1d5c52-e456-4cc3-9ecf-0e5f92868a92 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-7f08340f-9267-4764-8c00-826ad9fe215a req-0c1d5c52-e456-4cc3-9ecf-0e5f92868a92 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:01 user nova-compute[73091]: WARNING nova.compute.manager [req-7f08340f-9267-4764-8c00-826ad9fe215a req-0c1d5c52-e456-4cc3-9ecf-0e5f92868a92 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state stopped and task_state None.
Aug 16 15:21:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:21:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:21:03 user nova-compute[73091]: INFO nova.compute.claims [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Claim successful on node user
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:21:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:21:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Creating image(s)
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG nova.policy [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95fc30b3405462fa36a3851ca239445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864a6fc58ffc491aa91905472cca305b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk 1073741824" returned: 0 in 0.056s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Cannot resize image /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'migration_context' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Ensure instance console log exists: /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Successfully created port: 02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:21:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Successfully updated port: 02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing instance network info cache due to event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance network_info: |[{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Start _get_guest_xml network_info=[{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:21:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743738867',display_name='tempest-ServerStableDeviceRescueTest-server-1743738867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743738867',id=37,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa8h6cYvARfUqCV5JdjI6N0GPeWXt+eZwXI0stiH6F3WtxolVkANJ+wPxa4xuPVG9+smlfFXwmMkYw7q8Bhq7jnUPNjQRLTfqyIF3ty0Y1pQOE6gS5oF9+ZgUCbEBxODg==',key_name='tempest-keypair-2017314564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='864a6fc58ffc491aa91905472cca305b',ramdisk_id='',reservation_id='r-wttbpe4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1149513869',owner_user_name='tempest-ServerStableDeviceRescueTest-1149513869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95fc30b3405462fa36a3851ca239445',uuid=e7594dba-8a65-425f-9b10-35b9a0c5e57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converting VIF {"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'pci_devices' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:21:07 user nova-compute[73091]:   <uuid>e7594dba-8a65-425f-9b10-35b9a0c5e57a</uuid>
Aug 16 15:21:07 user nova-compute[73091]:   <name>instance-00000025</name>
Aug 16 15:21:07 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:21:07 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:21:07 user nova-compute[73091]:   <metadata>
Aug 16 15:21:07 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:21:07 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:21:07 user nova-compute[73091]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1743738867</nova:name>
Aug 16 15:21:07 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:21:07</nova:creationTime>
Aug 16 15:21:07 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:21:07 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:21:07 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:21:07 user nova-compute[73091]:       <nova:owner>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:user uuid="e95fc30b3405462fa36a3851ca239445">tempest-ServerStableDeviceRescueTest-1149513869-project-member</nova:user>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:project uuid="864a6fc58ffc491aa91905472cca305b">tempest-ServerStableDeviceRescueTest-1149513869</nova:project>
Aug 16 15:21:07 user nova-compute[73091]:       </nova:owner>
Aug 16 15:21:07 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:21:07 user nova-compute[73091]:       <nova:ports>
Aug 16 15:21:07 user nova-compute[73091]:         <nova:port uuid="02aa6015-41d4-4e38-aa29-9033e35b4a6b">
Aug 16 15:21:07 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:21:07 user nova-compute[73091]:         </nova:port>
Aug 16 15:21:07 user nova-compute[73091]:       </nova:ports>
Aug 16 15:21:07 user nova-compute[73091]:     </nova:instance>
Aug 16 15:21:07 user nova-compute[73091]:   </metadata>
Aug 16 15:21:07 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:21:07 user nova-compute[73091]:     <system>
Aug 16 15:21:07 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:21:07 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:21:07 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:21:07 user nova-compute[73091]:       <entry name="serial">e7594dba-8a65-425f-9b10-35b9a0c5e57a</entry>
Aug 16 15:21:07 user nova-compute[73091]:       <entry name="uuid">e7594dba-8a65-425f-9b10-35b9a0c5e57a</entry>
Aug 16 15:21:07 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:21:07 user nova-compute[73091]:     </system>
Aug 16 15:21:07 user nova-compute[73091]:   </sysinfo>
Aug 16 15:21:07 user nova-compute[73091]:   <os>
Aug 16 15:21:07 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:21:07 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:21:07 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:21:07 user nova-compute[73091]:   </os>
Aug 16 15:21:07 user nova-compute[73091]:   <features>
Aug 16 15:21:07 user nova-compute[73091]:     <acpi/>
Aug 16 15:21:07 user nova-compute[73091]:     <apic/>
Aug 16 15:21:07 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:21:07 user nova-compute[73091]:   </features>
Aug 16 15:21:07 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:21:07 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:21:07 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:21:07 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:21:07 user nova-compute[73091]:   </clock>
Aug 16 15:21:07 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:21:07 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:21:07 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:21:07 user nova-compute[73091]:   </cpu>
Aug 16 15:21:07 user nova-compute[73091]:   <devices>
Aug 16 15:21:07 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:21:07 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:21:07 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk"/>
Aug 16 15:21:07 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:21:07 user nova-compute[73091]:     </disk>
Aug 16 15:21:07 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:21:07 user nova-compute[73091]:       <mac address="fa:16:3e:94:6d:81"/>
Aug 16 15:21:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:21:07 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:21:07 user nova-compute[73091]:       <target dev="tap02aa6015-41"/>
Aug 16 15:21:07 user nova-compute[73091]:     </interface>
Aug 16 15:21:07 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:21:07 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/console.log" append="off"/>
Aug 16 15:21:07 user nova-compute[73091]:     </serial>
Aug 16 15:21:07 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:21:07 user nova-compute[73091]:     <video>
Aug 16 15:21:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:21:07 user nova-compute[73091]:     </video>
Aug 16 15:21:07 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:21:07 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:21:07 user nova-compute[73091]:     </rng>
Aug 16 15:21:07 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:21:07 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:21:07 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:21:07 user nova-compute[73091]:     </memballoon>
Aug 16 15:21:07 user nova-compute[73091]:   </devices>
Aug 16 15:21:07 user nova-compute[73091]: </domain>
Aug 16 15:21:07 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743738867',display_name='tempest-ServerStableDeviceRescueTest-server-1743738867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743738867',id=37,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa8h6cYvARfUqCV5JdjI6N0GPeWXt+eZwXI0stiH6F3WtxolVkANJ+wPxa4xuPVG9+smlfFXwmMkYw7q8Bhq7jnUPNjQRLTfqyIF3ty0Y1pQOE6gS5oF9+ZgUCbEBxODg==',key_name='tempest-keypair-2017314564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='864a6fc58ffc491aa91905472cca305b',ramdisk_id='',reservation_id='r-wttbpe4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1149513869',owner_user_name='tempest-ServerStableDeviceRescueTest-1149513869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95fc30b3405462fa36a3851ca239445',uuid=e7594dba-8a65-425f-9b10-35b9a0c5e57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converting VIF {"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG os_vif [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02aa6015-41, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02aa6015-41, col_values=(('external_ids', {'iface-id': '02aa6015-41d4-4e38-aa29-9033e35b4a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:6d:81', 'vm-uuid': 'e7594dba-8a65-425f-9b10-35b9a0c5e57a'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:07 user nova-compute[73091]: INFO os_vif [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41')
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No VIF found with MAC fa:16:3e:94:6d:81, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updated VIF entry in instance network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb2dbde3-71fa-4788-b7e5-35db85e7af82 req-3c866215-6d4f-4ce9-8f28-433bddf71537 service nova] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-d629d869-0ef6-47c4-9b62-6ef911ebf139 req-f3e1959b-15bf-4408-bd42-eaacf7a0f73c service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d629d869-0ef6-47c4-9b62-6ef911ebf139 req-f3e1959b-15bf-4408-bd42-eaacf7a0f73c service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d629d869-0ef6-47c4-9b62-6ef911ebf139 req-f3e1959b-15bf-4408-bd42-eaacf7a0f73c service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d629d869-0ef6-47c4-9b62-6ef911ebf139 req-f3e1959b-15bf-4408-bd42-eaacf7a0f73c service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-d629d869-0ef6-47c4-9b62-6ef911ebf139 req-f3e1959b-15bf-4408-bd42-eaacf7a0f73c service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:08 user nova-compute[73091]: WARNING nova.compute.manager [req-d629d869-0ef6-47c4-9b62-6ef911ebf139 req-f3e1959b-15bf-4408-bd42-eaacf7a0f73c service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state building and task_state spawning.
Aug 16 15:21:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-d6189369-aa0b-4425-b12b-0aeaa3071448 req-820ccceb-03d6-4c34-a6a2-c67cb97704c6 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d6189369-aa0b-4425-b12b-0aeaa3071448 req-820ccceb-03d6-4c34-a6a2-c67cb97704c6 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d6189369-aa0b-4425-b12b-0aeaa3071448 req-820ccceb-03d6-4c34-a6a2-c67cb97704c6 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d6189369-aa0b-4425-b12b-0aeaa3071448 req-820ccceb-03d6-4c34-a6a2-c67cb97704c6 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-d6189369-aa0b-4425-b12b-0aeaa3071448 req-820ccceb-03d6-4c34-a6a2-c67cb97704c6 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:11 user nova-compute[73091]: WARNING nova.compute.manager [req-d6189369-aa0b-4425-b12b-0aeaa3071448 req-820ccceb-03d6-4c34-a6a2-c67cb97704c6 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state building and task_state spawning.
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199271.3070045, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Resumed (Lifecycle Event)
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance spawned successfully.
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199271.310744, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Started (Lifecycle Event)
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Took 7.04 seconds to spawn the instance on the hypervisor.
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.manager [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Took 7.75 seconds to build instance.
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6acfab25-ff4c-4780-975f-16db0b5ef6f3 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.853s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b398d826-b534-4101-9d17-5e5d687afb57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:11 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:21:11 user nova-compute[73091]: INFO nova.compute.claims [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Claim successful on node user
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:21:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:21:12 user nova-compute[73091]: INFO nova.virt.block_device [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Booting with volume b3b90be8-55dc-49fe-a23e-b4e549771372 at /dev/vda
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.policy [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab71a5471a4bbcb7845d1293849449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f7da218a484e86a7c25626b2e178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG os_brick.utils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82fe4e6-685f-4dcd-a527-eaf8c8f91a7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46acc91-c576-4bea-85fd-5f3e522869da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485fcc5-14c7-4fb4-9c5b-6a0b6c35ab2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa624f6-3257-4c54-8265-34b28a4e4f21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:21:12 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:21:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66738af-8b8e-45a0-81c4-f40c53d9dc88]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG os_brick.utils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:21:12 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updating existing volume attachment record: 24fc6eb6-654e-495b-9a1e-a27b6200e513 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:21:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:13 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:21:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:21:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Successfully created port: ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:21:14 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199259.3501532, 725361f9-395a-4a19-9900-bacbb4315b92 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Stopped (Lifecycle Event)
Aug 16 15:21:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02b690a8-a56d-444c-8032-2f8ecd104784 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02b690a8-a56d-444c-8032-2f8ecd104784 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Successfully updated port: ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquired lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-changed-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Refreshing instance network info cache due to event network-changed-ec62d487-db27-40ca-a517-0ef6660e8d57. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] Acquiring lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updating instance_info_cache with network_info: [{"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Releasing lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Instance network_info: |[{"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] Acquired lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Refreshing network info cache for port ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updated VIF entry in instance network info cache for port ec62d487-db27-40ca-a517-0ef6660e8d57. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updating instance_info_cache with network_info: [{"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ca7681a1-29b0-4bc4-8734-2ba1220cbb3f req-20b1ee51-288b-4c57-82c8-e16eb329c0ca service nova] Releasing lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:21:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8403MB free_disk=25.366863250732422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:21:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b398d826-b534-4101-9d17-5e5d687afb57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing instance network info cache due to event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:21:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updated VIF entry in instance network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:21:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-87efd3d7-325e-4895-96d9-859082a496aa req-f4d38864-d4c1-4b52-acb4-e28acf495962 service nova] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:20 user nova-compute[73091]: INFO nova.compute.manager [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Detaching volume 6a7f7a1e-c369-4749-93bf-50220d9abbf3
Aug 16 15:21:20 user nova-compute[73091]: INFO nova.virt.block_device [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Attempting to driver detach volume 6a7f7a1e-c369-4749-93bf-50220d9abbf3 from mountpoint /dev/vdb
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Attempting to detach device vdb from instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:21:20 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:21:20 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:21:20 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:21:20 user nova-compute[73091]:   <serial>6a7f7a1e-c369-4749-93bf-50220d9abbf3</serial>
Aug 16 15:21:20 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:21:20 user nova-compute[73091]: </disk>
Aug 16 15:21:20 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:21:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully detached device vdb from instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac from the persistent domain config.
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:21:20 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:21:20 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:21:20 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:21:20 user nova-compute[73091]:   <serial>6a7f7a1e-c369-4749-93bf-50220d9abbf3</serial>
Aug 16 15:21:20 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:21:20 user nova-compute[73091]: </disk>
Aug 16 15:21:20 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199280.7538338, 4962ad4c-43c9-47a0-b26c-991cd8a37cac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:21:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully detached device vdb from instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac from the live domain config.
Aug 16 15:21:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHvNPneM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:21:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[17650015-8736-4df1-a68a-b9a26ee812a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f377ef-b1cc-45dd-aa88-a203b07b0bba]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:21:20 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:21:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 (non-flash)
Aug 16 15:21:20 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:21:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c57ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc60eb-c5af-4911-ba73-b67e93e66d2a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964e09f-9a1f-49cf-9772-798ae3f28efd]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1ba8a-c988-4f36-9b99-b2c2cd2fed72]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[869babd2-4a31-4f78-ac82-0c3dae55337c]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:21:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c740d37-4fed-46fd-9677-41d56baee78f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing instance network info cache due to event network-changed-71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] Acquiring lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] Acquired lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Refreshing network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd45331-c11e-419c-869a-f8a6dbd6c2e0]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260]
Aug 16 15:21:21 user nova-compute[73091]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3, portal: 172.16.0.220,3260] successful.
Aug 16 15:21:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7f7a1e-c369-4749-93bf-50220d9abbf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f26883-60ff-4100-b4a8-1c96818f8162]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] <== disconnect_volume: return (348ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updated VIF entry in instance network info cache for port 71059a4a-105a-4dbd-a8de-808746dcf159. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [{"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-17e26cda-02df-4265-942d-fbadb69e22cd req-abab074a-cda1-42d2-be2d-69e3f8060be8 service nova] Releasing lock "refresh_cache-4962ad4c-43c9-47a0-b26c-991cd8a37cac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'flavor' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-549ab442-e6c8-44ff-ad4d-24662c5568bd tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.937s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:21:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Creating image(s)
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Ensure instance console log exists: /opt/stack/data/nova/instances/b398d826-b534-4101-9d17-5e5d687afb57/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Start _get_guest_xml network_info=[{"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '24fc6eb6-654e-495b-9a1e-a27b6200e513', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viImWFeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b398d826-b534-4101-9d17-5e5d687afb57', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3b90be8-55dc-49fe-a23e-b4e549771372', 'serial': 'b3b90be8-55dc-49fe-a23e-b4e549771372'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:21:31 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:31 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viImWFeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:21:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:21:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:21:31 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffd465-ddd9-483a-8ab7-b1acb112fe14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:21:31 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda5eed-6d59-4de4-9d77-463ce3083e18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372] added
Aug 16 15:21:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d258f5-6923-4b94-9f74-09c746341c0a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d03315-ce09-4f72-9ebf-dd1ba9d42210]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viImWFeJ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viImWFeJ" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0195c1bd-3718-425b-a71e-b9d50763584b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viImWFeJ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bb2f3f-f03b-4da5-8c27-ea7665c0b627]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e958160e-7e99-4226-85bf-8a4f3058a36f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:21:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:21:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e431d-4a3d-4e17-a647-da07454b1952]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260]
Aug 16 15:21:32 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260] successful.
Aug 16 15:21:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6b8ed-1d92-45e7-9811-643715c0071d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc689cb8-0134-4de7-a420-3e8e0e9da10b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:21:32 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:21:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:21:32 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:21:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[781807b3-11c8-4373-8888-380966c6ae90]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:21:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viImWFeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26537393533353332', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537393533353332', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1365817395',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1365817395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1365817395',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTVdxLhhoxo8DeJoSn9qlVEc3kvoqAOYVPm9owbfc4aoYUMgCoS7soksR/XIZJ6sKvcrlJuVX4xyIX3SZEEAozigK7ow9Osa0YJ54RD0KFcojZ8la2f+jK4YfYksZUKg==',key_name='tempest-keypair-2059138311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-0ot97l77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=b398d826-b534-4101-9d17-5e5d687afb57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'pci_devices' on Instance uuid b398d826-b534-4101-9d17-5e5d687afb57 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:21:33 user nova-compute[73091]:   <uuid>b398d826-b534-4101-9d17-5e5d687afb57</uuid>
Aug 16 15:21:33 user nova-compute[73091]:   <name>instance-00000026</name>
Aug 16 15:21:33 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:21:33 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:21:33 user nova-compute[73091]:   <metadata>
Aug 16 15:21:33 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:21:33 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:21:33 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1365817395</nova:name>
Aug 16 15:21:33 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:21:31</nova:creationTime>
Aug 16 15:21:33 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:21:33 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:21:33 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:21:33 user nova-compute[73091]:       <nova:owner>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:user uuid="b8ab71a5471a4bbcb7845d1293849449">tempest-TestVolumeBootPattern-1172028538-project-member</nova:user>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:project uuid="1236f7da218a484e86a7c25626b2e178">tempest-TestVolumeBootPattern-1172028538</nova:project>
Aug 16 15:21:33 user nova-compute[73091]:       </nova:owner>
Aug 16 15:21:33 user nova-compute[73091]:       <nova:ports>
Aug 16 15:21:33 user nova-compute[73091]:         <nova:port uuid="ec62d487-db27-40ca-a517-0ef6660e8d57">
Aug 16 15:21:33 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 15:21:33 user nova-compute[73091]:         </nova:port>
Aug 16 15:21:33 user nova-compute[73091]:       </nova:ports>
Aug 16 15:21:33 user nova-compute[73091]:     </nova:instance>
Aug 16 15:21:33 user nova-compute[73091]:   </metadata>
Aug 16 15:21:33 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:21:33 user nova-compute[73091]:     <system>
Aug 16 15:21:33 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:21:33 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:21:33 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:21:33 user nova-compute[73091]:       <entry name="serial">b398d826-b534-4101-9d17-5e5d687afb57</entry>
Aug 16 15:21:33 user nova-compute[73091]:       <entry name="uuid">b398d826-b534-4101-9d17-5e5d687afb57</entry>
Aug 16 15:21:33 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:21:33 user nova-compute[73091]:     </system>
Aug 16 15:21:33 user nova-compute[73091]:   </sysinfo>
Aug 16 15:21:33 user nova-compute[73091]:   <os>
Aug 16 15:21:33 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:21:33 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:21:33 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:21:33 user nova-compute[73091]:   </os>
Aug 16 15:21:33 user nova-compute[73091]:   <features>
Aug 16 15:21:33 user nova-compute[73091]:     <acpi/>
Aug 16 15:21:33 user nova-compute[73091]:     <apic/>
Aug 16 15:21:33 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:21:33 user nova-compute[73091]:   </features>
Aug 16 15:21:33 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:21:33 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:21:33 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:21:33 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:21:33 user nova-compute[73091]:   </clock>
Aug 16 15:21:33 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:21:33 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:21:33 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:21:33 user nova-compute[73091]:   </cpu>
Aug 16 15:21:33 user nova-compute[73091]:   <devices>
Aug 16 15:21:33 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:21:33 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:21:33 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 15:21:33 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:21:33 user nova-compute[73091]:       <serial>b3b90be8-55dc-49fe-a23e-b4e549771372</serial>
Aug 16 15:21:33 user nova-compute[73091]:     </disk>
Aug 16 15:21:33 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:21:33 user nova-compute[73091]:       <mac address="fa:16:3e:c1:05:88"/>
Aug 16 15:21:33 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:21:33 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:21:33 user nova-compute[73091]:       <target dev="tapec62d487-db"/>
Aug 16 15:21:33 user nova-compute[73091]:     </interface>
Aug 16 15:21:33 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:21:33 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b398d826-b534-4101-9d17-5e5d687afb57/console.log" append="off"/>
Aug 16 15:21:33 user nova-compute[73091]:     </serial>
Aug 16 15:21:33 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:21:33 user nova-compute[73091]:     <video>
Aug 16 15:21:33 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:21:33 user nova-compute[73091]:     </video>
Aug 16 15:21:33 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:21:33 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:21:33 user nova-compute[73091]:     </rng>
Aug 16 15:21:33 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:21:33 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:21:33 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:21:33 user nova-compute[73091]:     </memballoon>
Aug 16 15:21:33 user nova-compute[73091]:   </devices>
Aug 16 15:21:33 user nova-compute[73091]: </domain>
Aug 16 15:21:33 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1365817395',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1365817395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1365817395',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTVdxLhhoxo8DeJoSn9qlVEc3kvoqAOYVPm9owbfc4aoYUMgCoS7soksR/XIZJ6sKvcrlJuVX4xyIX3SZEEAozigK7ow9Osa0YJ54RD0KFcojZ8la2f+jK4YfYksZUKg==',key_name='tempest-keypair-2059138311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-0ot97l77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=b398d826-b534-4101-9d17-5e5d687afb57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG os_vif [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec62d487-db, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec62d487-db, col_values=(('external_ids', {'iface-id': 'ec62d487-db27-40ca-a517-0ef6660e8d57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:05:88', 'vm-uuid': 'b398d826-b534-4101-9d17-5e5d687afb57'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:33 user nova-compute[73091]: INFO os_vif [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db')
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:21:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No VIF found with MAC fa:16:3e:c1:05:88, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:21:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ac82a75-3332-409a-b854-49be355bba53 req-1c4a1c06-5c9d-453d-a51b-0e2a9f10e808 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ac82a75-3332-409a-b854-49be355bba53 req-1c4a1c06-5c9d-453d-a51b-0e2a9f10e808 service nova] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ac82a75-3332-409a-b854-49be355bba53 req-1c4a1c06-5c9d-453d-a51b-0e2a9f10e808 service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ac82a75-3332-409a-b854-49be355bba53 req-1c4a1c06-5c9d-453d-a51b-0e2a9f10e808 service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ac82a75-3332-409a-b854-49be355bba53 req-1c4a1c06-5c9d-453d-a51b-0e2a9f10e808 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] No waiting events found dispatching network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:35 user nova-compute[73091]: WARNING nova.compute.manager [req-6ac82a75-3332-409a-b854-49be355bba53 req-1c4a1c06-5c9d-453d-a51b-0e2a9f10e808 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received unexpected event network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 for instance with vm_state building and task_state spawning.
Aug 16 15:21:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-49e684ba-447d-4e99-885b-756a026d5886 req-c1f97095-15d0-477d-a221-e15829b69c91 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49e684ba-447d-4e99-885b-756a026d5886 req-c1f97095-15d0-477d-a221-e15829b69c91 service nova] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49e684ba-447d-4e99-885b-756a026d5886 req-c1f97095-15d0-477d-a221-e15829b69c91 service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-49e684ba-447d-4e99-885b-756a026d5886 req-c1f97095-15d0-477d-a221-e15829b69c91 service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-49e684ba-447d-4e99-885b-756a026d5886 req-c1f97095-15d0-477d-a221-e15829b69c91 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] No waiting events found dispatching network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:37 user nova-compute[73091]: WARNING nova.compute.manager [req-49e684ba-447d-4e99-885b-756a026d5886 req-c1f97095-15d0-477d-a221-e15829b69c91 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received unexpected event network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 for instance with vm_state building and task_state spawning.
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199297.3844585, b398d826-b534-4101-9d17-5e5d687afb57 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] VM Resumed (Lifecycle Event)
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Instance spawned successfully.
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199297.3870177, b398d826-b534-4101-9d17-5e5d687afb57 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] VM Started (Lifecycle Event)
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 16 15:21:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:37 user nova-compute[73091]: INFO nova.compute.manager [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Took 25.78 seconds to build instance.
Aug 16 15:21:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86aa9773-8cc0-4c8d-a540-9b2e5b0ee557 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b398d826-b534-4101-9d17-5e5d687afb57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.885s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:21:43 user nova-compute[73091]: INFO nova.compute.claims [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Claim successful on node user
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:21:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:21:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG nova.policy [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9f5d292acc34c5f838ba869d2b6a888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae64708e843e4a48aad2edc318218b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:21:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Creating image(s)
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "/opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "/opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "/opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.234s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.259s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk 1073741824" returned: 0 in 0.066s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:21:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Successfully created port: 52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Cannot resize image /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'migration_context' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Ensure instance console log exists: /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Successfully updated port: 52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquired lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-changed-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Refreshing instance network info cache due to event network-changed-52e44f39-a69e-49e9-9e72-013b63cdf1f9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] Acquiring lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:21:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Releasing lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Instance network_info: |[{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] Acquired lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Refreshing network info cache for port 52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Start _get_guest_xml network_info=[{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:21:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-330066798',display_name='tempest-SnapshotDataIntegrityTests-server-330066798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-330066798',id=39,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fVGpVkcmOBrIz8wD9JCMkKW9l/sm1bvrmKy4qU2Be8OZ5fGX3v6MXwOJFAbDpFOntKGgg28bPn9iN2O5v3umVgHmsXHlQGdnj1VhA6k0SAj2IC7rJt2fzlRiGS2w37Q==',key_name='tempest-keypair-899870127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae64708e843e4a48aad2edc318218b13',ramdisk_id='',reservation_id='r-lvy5lo03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1462586186',owner_user_name='tempest-SnapshotDataIntegrityTests-1462586186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9f5d292acc34c5f838ba869d2b6a888',uuid=7afa3d53-b3ac-446c-8d4a-b17438c6ec3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Converting VIF {"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'pci_devices' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:21:46 user nova-compute[73091]:   <uuid>7afa3d53-b3ac-446c-8d4a-b17438c6ec3a</uuid>
Aug 16 15:21:46 user nova-compute[73091]:   <name>instance-00000027</name>
Aug 16 15:21:46 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:21:46 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:21:46 user nova-compute[73091]:   <metadata>
Aug 16 15:21:46 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:21:46 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:21:46 user nova-compute[73091]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-330066798</nova:name>
Aug 16 15:21:46 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:21:46</nova:creationTime>
Aug 16 15:21:46 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:21:46 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:21:46 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:21:46 user nova-compute[73091]:       <nova:owner>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:user uuid="f9f5d292acc34c5f838ba869d2b6a888">tempest-SnapshotDataIntegrityTests-1462586186-project-member</nova:user>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:project uuid="ae64708e843e4a48aad2edc318218b13">tempest-SnapshotDataIntegrityTests-1462586186</nova:project>
Aug 16 15:21:46 user nova-compute[73091]:       </nova:owner>
Aug 16 15:21:46 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:21:46 user nova-compute[73091]:       <nova:ports>
Aug 16 15:21:46 user nova-compute[73091]:         <nova:port uuid="52e44f39-a69e-49e9-9e72-013b63cdf1f9">
Aug 16 15:21:46 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:21:46 user nova-compute[73091]:         </nova:port>
Aug 16 15:21:46 user nova-compute[73091]:       </nova:ports>
Aug 16 15:21:46 user nova-compute[73091]:     </nova:instance>
Aug 16 15:21:46 user nova-compute[73091]:   </metadata>
Aug 16 15:21:46 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:21:46 user nova-compute[73091]:     <system>
Aug 16 15:21:46 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:21:46 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:21:46 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:21:46 user nova-compute[73091]:       <entry name="serial">7afa3d53-b3ac-446c-8d4a-b17438c6ec3a</entry>
Aug 16 15:21:46 user nova-compute[73091]:       <entry name="uuid">7afa3d53-b3ac-446c-8d4a-b17438c6ec3a</entry>
Aug 16 15:21:46 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:21:46 user nova-compute[73091]:     </system>
Aug 16 15:21:46 user nova-compute[73091]:   </sysinfo>
Aug 16 15:21:46 user nova-compute[73091]:   <os>
Aug 16 15:21:46 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:21:46 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:21:46 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:21:46 user nova-compute[73091]:   </os>
Aug 16 15:21:46 user nova-compute[73091]:   <features>
Aug 16 15:21:46 user nova-compute[73091]:     <acpi/>
Aug 16 15:21:46 user nova-compute[73091]:     <apic/>
Aug 16 15:21:46 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:21:46 user nova-compute[73091]:   </features>
Aug 16 15:21:46 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:21:46 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:21:46 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:21:46 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:21:46 user nova-compute[73091]:   </clock>
Aug 16 15:21:46 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:21:46 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:21:46 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:21:46 user nova-compute[73091]:   </cpu>
Aug 16 15:21:46 user nova-compute[73091]:   <devices>
Aug 16 15:21:46 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:21:46 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:21:46 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk"/>
Aug 16 15:21:46 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:21:46 user nova-compute[73091]:     </disk>
Aug 16 15:21:46 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:21:46 user nova-compute[73091]:       <mac address="fa:16:3e:04:22:72"/>
Aug 16 15:21:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:21:46 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:21:46 user nova-compute[73091]:       <target dev="tap52e44f39-a6"/>
Aug 16 15:21:46 user nova-compute[73091]:     </interface>
Aug 16 15:21:46 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:21:46 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/console.log" append="off"/>
Aug 16 15:21:46 user nova-compute[73091]:     </serial>
Aug 16 15:21:46 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:21:46 user nova-compute[73091]:     <video>
Aug 16 15:21:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:21:46 user nova-compute[73091]:     </video>
Aug 16 15:21:46 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:21:46 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:21:46 user nova-compute[73091]:     </rng>
Aug 16 15:21:46 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:21:46 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:21:46 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:21:46 user nova-compute[73091]:     </memballoon>
Aug 16 15:21:46 user nova-compute[73091]:   </devices>
Aug 16 15:21:46 user nova-compute[73091]: </domain>
Aug 16 15:21:46 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-330066798',display_name='tempest-SnapshotDataIntegrityTests-server-330066798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-330066798',id=39,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fVGpVkcmOBrIz8wD9JCMkKW9l/sm1bvrmKy4qU2Be8OZ5fGX3v6MXwOJFAbDpFOntKGgg28bPn9iN2O5v3umVgHmsXHlQGdnj1VhA6k0SAj2IC7rJt2fzlRiGS2w37Q==',key_name='tempest-keypair-899870127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae64708e843e4a48aad2edc318218b13',ramdisk_id='',reservation_id='r-lvy5lo03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1462586186',owner_user_name='tempest-SnapshotDataIntegrityTests-1462586186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9f5d292acc34c5f838ba869d2b6a888',uuid=7afa3d53-b3ac-446c-8d4a-b17438c6ec3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Converting VIF {"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG os_vif [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e44f39-a6, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52e44f39-a6, col_values=(('external_ids', {'iface-id': '52e44f39-a69e-49e9-9e72-013b63cdf1f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:22:72', 'vm-uuid': '7afa3d53-b3ac-446c-8d4a-b17438c6ec3a'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:46 user nova-compute[73091]: INFO os_vif [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6')
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No VIF found with MAC fa:16:3e:04:22:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updated VIF entry in instance network info cache for port 52e44f39-a69e-49e9-9e72-013b63cdf1f9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:21:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f36175a6-2f2f-4b1a-9ccf-61a7cd7e05c4 req-9f35efff-a66d-4ebd-ab57-a543c4e1ee5f service nova] Releasing lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:21:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-82ac950b-34c8-4acb-8ae6-fe58c11a6799 req-c8ab8ef2-3fa6-488e-9e27-683ef4d0d30f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-82ac950b-34c8-4acb-8ae6-fe58c11a6799 req-c8ab8ef2-3fa6-488e-9e27-683ef4d0d30f service nova] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-82ac950b-34c8-4acb-8ae6-fe58c11a6799 req-c8ab8ef2-3fa6-488e-9e27-683ef4d0d30f service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-82ac950b-34c8-4acb-8ae6-fe58c11a6799 req-c8ab8ef2-3fa6-488e-9e27-683ef4d0d30f service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-82ac950b-34c8-4acb-8ae6-fe58c11a6799 req-c8ab8ef2-3fa6-488e-9e27-683ef4d0d30f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] No waiting events found dispatching network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:48 user nova-compute[73091]: WARNING nova.compute.manager [req-82ac950b-34c8-4acb-8ae6-fe58c11a6799 req-c8ab8ef2-3fa6-488e-9e27-683ef4d0d30f service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received unexpected event network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 for instance with vm_state building and task_state spawning.
Aug 16 15:21:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199310.410358, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] VM Resumed (Lifecycle Event)
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:21:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Instance spawned successfully.
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d2ada71-f084-4cc2-b096-7002b909ad56 req-dce67db9-6a87-4efc-aa44-7bacc6b2e785 service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d2ada71-f084-4cc2-b096-7002b909ad56 req-dce67db9-6a87-4efc-aa44-7bacc6b2e785 service nova] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d2ada71-f084-4cc2-b096-7002b909ad56 req-dce67db9-6a87-4efc-aa44-7bacc6b2e785 service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d2ada71-f084-4cc2-b096-7002b909ad56 req-dce67db9-6a87-4efc-aa44-7bacc6b2e785 service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d2ada71-f084-4cc2-b096-7002b909ad56 req-dce67db9-6a87-4efc-aa44-7bacc6b2e785 service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] No waiting events found dispatching network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:21:50 user nova-compute[73091]: WARNING nova.compute.manager [req-4d2ada71-f084-4cc2-b096-7002b909ad56 req-dce67db9-6a87-4efc-aa44-7bacc6b2e785 service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received unexpected event network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 for instance with vm_state building and task_state spawning.
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199310.4181068, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:21:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] VM Started (Lifecycle Event)
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:21:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:21:50 user nova-compute[73091]: INFO nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 16 15:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:21:51 user nova-compute[73091]: INFO nova.compute.manager [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Took 7.74 seconds to build instance.
Aug 16 15:21:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94c36b7b-9720-471b-a0c8-5d5d73964b57 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.888s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:21:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:21:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:17 user nova-compute[73091]: INFO nova.compute.manager [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Terminating instance
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-7cf92121-e195-4aa9-a157-60ff6ad0c99e req-c526eaba-450c-4dfd-808c-a04e10a70454 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-unplugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7cf92121-e195-4aa9-a157-60ff6ad0c99e req-c526eaba-450c-4dfd-808c-a04e10a70454 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7cf92121-e195-4aa9-a157-60ff6ad0c99e req-c526eaba-450c-4dfd-808c-a04e10a70454 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7cf92121-e195-4aa9-a157-60ff6ad0c99e req-c526eaba-450c-4dfd-808c-a04e10a70454 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-7cf92121-e195-4aa9-a157-60ff6ad0c99e req-c526eaba-450c-4dfd-808c-a04e10a70454 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-unplugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-7cf92121-e195-4aa9-a157-60ff6ad0c99e req-c526eaba-450c-4dfd-808c-a04e10a70454 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-unplugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:22:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Instance destroyed successfully.
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lazy-loading 'resources' on Instance uuid 4962ad4c-43c9-47a0-b26c-991cd8a37cac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2131393725',display_name='tempest-TestMinimumBasicScenario-server-2131393725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2131393725',id=34,image_ref='83af4770-1980-46e6-b3db-047cd7d92ad4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnslhFeTBWMyP4VfSZdOrmH/JSibs/6GQP81I1H0Cp8J6z04euXHHCBIeU5peBp3nmorBtlYvb8BqoEkAZNVg8QAlY15kmMmATNOrzNiY8tbuZFdtn9C4nRrfrnc9e5TQ==',key_name='tempest-TestMinimumBasicScenario-1646901935',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eccc077091084e3da6c5eba044a428bd',ramdisk_id='',reservation_id='r-ev9irch6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='83af4770-1980-46e6-b3db-047cd7d92ad4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1639423549',owner_user_name='tempest-TestMinimumBasicScenario-1639423549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:19:34Z,user_data=None,user_id='ceda77fdee15448c9c18cc1a1c64d0fb',uuid=4962ad4c-43c9-47a0-b26c-991cd8a37cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converting VIF {"id": "71059a4a-105a-4dbd-a8de-808746dcf159", "address": "fa:16:3e:af:2e:1c", "network": {"id": "a10346af-e4e3-4e8d-85bb-28900b3ce181", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-859938806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccc077091084e3da6c5eba044a428bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71059a4a-10", "ovs_interfaceid": "71059a4a-105a-4dbd-a8de-808746dcf159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG os_vif [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71059a4a-10, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:18 user nova-compute[73091]: INFO os_vif [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=71059a4a-105a-4dbd-a8de-808746dcf159,network=Network(a10346af-e4e3-4e8d-85bb-28900b3ce181),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71059a4a-10')
Aug 16 15:22:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Deleting instance files /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac_del
Aug 16 15:22:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Deletion of /opt/stack/data/nova/instances/4962ad4c-43c9-47a0-b26c-991cd8a37cac_del complete
Aug 16 15:22:18 user nova-compute[73091]: INFO nova.compute.manager [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:22:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid '4962ad4c-43c9-47a0-b26c-991cd8a37cac' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid '4962ad4c-43c9-47a0-b26c-991cd8a37cac' (instance-00000022)
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:22:18 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Took 0.61 seconds to deallocate network for instance.
Aug 16 15:22:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-1401ca74-73b6-47dd-94a6-d629cda238f9 req-5d8018ad-23fe-476c-81f3-c838e56b6376 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-deleted-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:19 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Deleted allocations for instance 4962ad4c-43c9-47a0-b26c-991cd8a37cac
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-270ce6b9-ca0d-4252-8a41-6679cc48cf36 tempest-TestMinimumBasicScenario-1639423549 tempest-TestMinimumBasicScenario-1639423549-project-member] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-0224c5ea-0f77-4411-acbf-a87e71dd41fe req-57ac679c-1899-4e67-b0d6-bcb46ca97540 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0224c5ea-0f77-4411-acbf-a87e71dd41fe req-57ac679c-1899-4e67-b0d6-bcb46ca97540 service nova] Acquiring lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0224c5ea-0f77-4411-acbf-a87e71dd41fe req-57ac679c-1899-4e67-b0d6-bcb46ca97540 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0224c5ea-0f77-4411-acbf-a87e71dd41fe req-57ac679c-1899-4e67-b0d6-bcb46ca97540 service nova] Lock "4962ad4c-43c9-47a0-b26c-991cd8a37cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-0224c5ea-0f77-4411-acbf-a87e71dd41fe req-57ac679c-1899-4e67-b0d6-bcb46ca97540 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] No waiting events found dispatching network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:22:19 user nova-compute[73091]: WARNING nova.compute.manager [req-0224c5ea-0f77-4411-acbf-a87e71dd41fe req-57ac679c-1899-4e67-b0d6-bcb46ca97540 service nova] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Received unexpected event network-vif-plugged-71059a4a-105a-4dbd-a8de-808746dcf159 for instance with vm_state deleted and task_state None.
Aug 16 15:22:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:22:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8134MB free_disk=25.29623794555664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b398d826-b534-4101-9d17-5e5d687afb57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:22:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:22:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:22:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:22:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:22:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:22:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:22:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:22:32 user nova-compute[73091]: INFO nova.compute.claims [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Claim successful on node user
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:22:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:22:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Creating image(s)
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "/opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "/opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199337.9544644, 4962ad4c-43c9-47a0-b26c-991cd8a37cac => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:22:32 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] VM Stopped (Lifecycle Event)
Aug 16 15:22:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f3ac91b-f306-4453-b2b5-dbc272093220 None None] [instance: 4962ad4c-43c9-47a0-b26c-991cd8a37cac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk 1073741824" returned: 0 in 0.055s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.policy [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea0797ada164408eb2c51f4d415c7d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1546518eb404e936a10c62da3866f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Cannot resize image /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lazy-loading 'migration_context' on Instance uuid 9dda7814-70fc-4b22-96d4-a64a10e86c1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Ensure instance console log exists: /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Successfully created port: 53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:22:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Successfully updated port: 53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:22:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "refresh_cache-9dda7814-70fc-4b22-96d4-a64a10e86c1b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:22:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquired lock "refresh_cache-9dda7814-70fc-4b22-96d4-a64a10e86c1b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:22:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-changed-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Refreshing instance network info cache due to event network-changed-53713020-c858-48dd-bb8e-d2bf140b00d2. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] Acquiring lock "refresh_cache-9dda7814-70fc-4b22-96d4-a64a10e86c1b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Updating instance_info_cache with network_info: [{"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Releasing lock "refresh_cache-9dda7814-70fc-4b22-96d4-a64a10e86c1b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Instance network_info: |[{"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] Acquired lock "refresh_cache-9dda7814-70fc-4b22-96d4-a64a10e86c1b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Refreshing network info cache for port 53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Start _get_guest_xml network_info=[{"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:22:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:22:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-403565502',display_name='tempest-VolumesNegativeTest-instance-403565502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-403565502',id=40,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce1546518eb404e936a10c62da3866f',ramdisk_id='',reservation_id='r-i74j35s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-995518035',owner_user_name='tempest-VolumesNegativeTest-995518035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:22:33Z,user_data=None,user_id='ea0797ada164408eb2c51f4d415c7d17',uuid=9dda7814-70fc-4b22-96d4-a64a10e86c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Converting VIF {"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dda7814-70fc-4b22-96d4-a64a10e86c1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:22:35 user nova-compute[73091]:   <uuid>9dda7814-70fc-4b22-96d4-a64a10e86c1b</uuid>
Aug 16 15:22:35 user nova-compute[73091]:   <name>instance-00000028</name>
Aug 16 15:22:35 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:22:35 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:22:35 user nova-compute[73091]:   <metadata>
Aug 16 15:22:35 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:22:35 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:22:35 user nova-compute[73091]:       <nova:name>tempest-VolumesNegativeTest-instance-403565502</nova:name>
Aug 16 15:22:35 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:22:35</nova:creationTime>
Aug 16 15:22:35 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:22:35 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:22:35 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:22:35 user nova-compute[73091]:       <nova:owner>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:user uuid="ea0797ada164408eb2c51f4d415c7d17">tempest-VolumesNegativeTest-995518035-project-member</nova:user>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:project uuid="8ce1546518eb404e936a10c62da3866f">tempest-VolumesNegativeTest-995518035</nova:project>
Aug 16 15:22:35 user nova-compute[73091]:       </nova:owner>
Aug 16 15:22:35 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:22:35 user nova-compute[73091]:       <nova:ports>
Aug 16 15:22:35 user nova-compute[73091]:         <nova:port uuid="53713020-c858-48dd-bb8e-d2bf140b00d2">
Aug 16 15:22:35 user nova-compute[73091]:           <nova:ip type="fixed" address="192.168.233.178" ipVersion="4"/>
Aug 16 15:22:35 user nova-compute[73091]:         </nova:port>
Aug 16 15:22:35 user nova-compute[73091]:       </nova:ports>
Aug 16 15:22:35 user nova-compute[73091]:     </nova:instance>
Aug 16 15:22:35 user nova-compute[73091]:   </metadata>
Aug 16 15:22:35 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:22:35 user nova-compute[73091]:     <system>
Aug 16 15:22:35 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:22:35 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:22:35 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:22:35 user nova-compute[73091]:       <entry name="serial">9dda7814-70fc-4b22-96d4-a64a10e86c1b</entry>
Aug 16 15:22:35 user nova-compute[73091]:       <entry name="uuid">9dda7814-70fc-4b22-96d4-a64a10e86c1b</entry>
Aug 16 15:22:35 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:22:35 user nova-compute[73091]:     </system>
Aug 16 15:22:35 user nova-compute[73091]:   </sysinfo>
Aug 16 15:22:35 user nova-compute[73091]:   <os>
Aug 16 15:22:35 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:22:35 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:22:35 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:22:35 user nova-compute[73091]:   </os>
Aug 16 15:22:35 user nova-compute[73091]:   <features>
Aug 16 15:22:35 user nova-compute[73091]:     <acpi/>
Aug 16 15:22:35 user nova-compute[73091]:     <apic/>
Aug 16 15:22:35 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:22:35 user nova-compute[73091]:   </features>
Aug 16 15:22:35 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:22:35 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:22:35 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:22:35 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:22:35 user nova-compute[73091]:   </clock>
Aug 16 15:22:35 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:22:35 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:22:35 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:22:35 user nova-compute[73091]:   </cpu>
Aug 16 15:22:35 user nova-compute[73091]:   <devices>
Aug 16 15:22:35 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:22:35 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:22:35 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk"/>
Aug 16 15:22:35 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:22:35 user nova-compute[73091]:     </disk>
Aug 16 15:22:35 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:22:35 user nova-compute[73091]:       <mac address="fa:16:3e:6f:69:a1"/>
Aug 16 15:22:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:22:35 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:22:35 user nova-compute[73091]:       <target dev="tap53713020-c8"/>
Aug 16 15:22:35 user nova-compute[73091]:     </interface>
Aug 16 15:22:35 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:22:35 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/console.log" append="off"/>
Aug 16 15:22:35 user nova-compute[73091]:     </serial>
Aug 16 15:22:35 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:22:35 user nova-compute[73091]:     <video>
Aug 16 15:22:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:22:35 user nova-compute[73091]:     </video>
Aug 16 15:22:35 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:22:35 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:22:35 user nova-compute[73091]:     </rng>
Aug 16 15:22:35 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:22:35 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:22:35 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:22:35 user nova-compute[73091]:     </memballoon>
Aug 16 15:22:35 user nova-compute[73091]:   </devices>
Aug 16 15:22:35 user nova-compute[73091]: </domain>
Aug 16 15:22:35 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-403565502',display_name='tempest-VolumesNegativeTest-instance-403565502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-403565502',id=40,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce1546518eb404e936a10c62da3866f',ramdisk_id='',reservation_id='r-i74j35s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-995518035',owner_user_name='tempest-VolumesNegativeTest-995518035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:22:33Z,user_data=None,user_id='ea0797ada164408eb2c51f4d415c7d17',uuid=9dda7814-70fc-4b22-96d4-a64a10e86c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Converting VIF {"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG os_vif [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53713020-c8, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53713020-c8, col_values=(('external_ids', {'iface-id': '53713020-c858-48dd-bb8e-d2bf140b00d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:69:a1', 'vm-uuid': '9dda7814-70fc-4b22-96d4-a64a10e86c1b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:35 user nova-compute[73091]: INFO os_vif [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8')
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] No VIF found with MAC fa:16:3e:6f:69:a1, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Updated VIF entry in instance network info cache for port 53713020-c858-48dd-bb8e-d2bf140b00d2. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Updating instance_info_cache with network_info: [{"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:22:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3542f969-f576-459d-9fff-5d27849f9fb1 req-33e4d550-e733-4dff-a07f-ee201afc0216 service nova] Releasing lock "refresh_cache-9dda7814-70fc-4b22-96d4-a64a10e86c1b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:22:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-4c458323-f9a6-448c-ac20-b8d9542a4194 req-1a1faeaf-c04f-4a35-a206-4c63d62a1261 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4c458323-f9a6-448c-ac20-b8d9542a4194 req-1a1faeaf-c04f-4a35-a206-4c63d62a1261 service nova] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4c458323-f9a6-448c-ac20-b8d9542a4194 req-1a1faeaf-c04f-4a35-a206-4c63d62a1261 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4c458323-f9a6-448c-ac20-b8d9542a4194 req-1a1faeaf-c04f-4a35-a206-4c63d62a1261 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-4c458323-f9a6-448c-ac20-b8d9542a4194 req-1a1faeaf-c04f-4a35-a206-4c63d62a1261 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] No waiting events found dispatching network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:22:37 user nova-compute[73091]: WARNING nova.compute.manager [req-4c458323-f9a6-448c-ac20-b8d9542a4194 req-1a1faeaf-c04f-4a35-a206-4c63d62a1261 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received unexpected event network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 for instance with vm_state building and task_state spawning.
Aug 16 15:22:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199359.1332116, 9dda7814-70fc-4b22-96d4-a64a10e86c1b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] VM Resumed (Lifecycle Event)
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Instance spawned successfully.
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199359.134566, 9dda7814-70fc-4b22-96d4-a64a10e86c1b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] VM Started (Lifecycle Event)
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:39 user nova-compute[73091]: INFO nova.compute.manager [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Took 7.35 seconds to build instance.
Aug 16 15:22:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-04c71ec8-0f58-4074-997c-bb7c7829d660 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.455s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-cfa197b4-af6b-4d52-a478-84c8d080b763 req-9e6536d4-2556-41ef-93f3-3e8533108808 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cfa197b4-af6b-4d52-a478-84c8d080b763 req-9e6536d4-2556-41ef-93f3-3e8533108808 service nova] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cfa197b4-af6b-4d52-a478-84c8d080b763 req-9e6536d4-2556-41ef-93f3-3e8533108808 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cfa197b4-af6b-4d52-a478-84c8d080b763 req-9e6536d4-2556-41ef-93f3-3e8533108808 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-cfa197b4-af6b-4d52-a478-84c8d080b763 req-9e6536d4-2556-41ef-93f3-3e8533108808 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] No waiting events found dispatching network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:22:39 user nova-compute[73091]: WARNING nova.compute.manager [req-cfa197b4-af6b-4d52-a478-84c8d080b763 req-9e6536d4-2556-41ef-93f3-3e8533108808 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received unexpected event network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 for instance with vm_state active and task_state None.
Aug 16 15:22:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:22:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:22:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:22:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'info_cache' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:22:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance destroyed successfully.
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'resources' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c46ede2-2e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:50 user nova-compute[73091]: INFO os_vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e')
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:22:50 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b737636-703a-4307-8109-58d67e3c1ebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[45147f2d-9600-48ec-89ea-20041d329d53]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:22:50 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:22:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:22:50 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:22:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115a35fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14faa0a-1366-4f0f-8983-8cb0ae369b7d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c891c4ea-26cd-45e8-8e40-e9e023913b5a]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca06082-ca3a-4825-91a1-e22db487fea3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[308ad996-b8ef-497d-85a5-de106906490d]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5abd21-b20d-45e0-9ca5-b2785df6f27e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c89c52-12fb-4695-895b-5673f35986ea]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]
Aug 16 15:22:50 user nova-compute[73091]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.
Aug 16 15:22:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2126db12-ff83-4852-b333-208b96ae9dd3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== disconnect_volume: return (300ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start _get_guest_xml network_info=[{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'b2330261-6c65-450b-90a0-868f3c10fba1', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '725361f9-395a-4a19-9900-bacbb4315b92', 'attached_at': '', 'detached_at': '', 'volume_id': '366767b6-4587-45a5-89a8-3d2f7455f658', 'serial': '366767b6-4587-45a5-89a8-3d2f7455f658'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'numa_topology' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:22:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:22:50 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:22:50 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:22:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:22:51 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1b3dd-de8f-43d5-919e-7aca4b7b6b65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:22:51 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[898bff80-9f77-4959-8c47-5e1372b07566]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658] added
Aug 16 15:22:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b74340-f8a7-4e91-8045-c3b3b316d4a9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ce900-8105-4354-99ee-cdfea6b52d72]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAOEMbDz {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAOEMbDz" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3deebc9-476c-46c7-8a2a-dbdeca56a3ac]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZAOEMbDz'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475837d-3417-46e6-b3f0-b0db66df7300]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10939cd-9462-4ba1-b583-ff7db9f5149c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:22:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:22:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2874b0-5101-4adf-aa8f-f3dcd66319d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]
Aug 16 15:22:51 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.
Aug 16 15:22:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b398519-98b2-425d-8228-2594fe220b51]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[909334a2-8d32-4a89-a902-0f9d244e2390]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:22:51 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:22:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:22:51 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:22:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[779070ba-c560-4218-8c2b-51fb60e8efe7]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:22:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26638313330393630', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638313330393630', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'pci_devices' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:22:52 user nova-compute[73091]:   <uuid>725361f9-395a-4a19-9900-bacbb4315b92</uuid>
Aug 16 15:22:52 user nova-compute[73091]:   <name>instance-00000024</name>
Aug 16 15:22:52 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:22:52 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:22:52 user nova-compute[73091]:   <metadata>
Aug 16 15:22:52 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:22:52 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:22:52 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-595386289</nova:name>
Aug 16 15:22:52 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:22:50</nova:creationTime>
Aug 16 15:22:52 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:22:52 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:22:52 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:22:52 user nova-compute[73091]:       <nova:owner>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:user uuid="4323609874c6400a986d1041316e8e78">tempest-AttachVolumeTestJSON-1875838463-project-member</nova:user>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:project uuid="2d9fa8ad962c43d4997806056d83f4a4">tempest-AttachVolumeTestJSON-1875838463</nova:project>
Aug 16 15:22:52 user nova-compute[73091]:       </nova:owner>
Aug 16 15:22:52 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:22:52 user nova-compute[73091]:       <nova:ports>
Aug 16 15:22:52 user nova-compute[73091]:         <nova:port uuid="4c46ede2-2e38-4999-aa47-2c7f3a36f65f">
Aug 16 15:22:52 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:22:52 user nova-compute[73091]:         </nova:port>
Aug 16 15:22:52 user nova-compute[73091]:       </nova:ports>
Aug 16 15:22:52 user nova-compute[73091]:     </nova:instance>
Aug 16 15:22:52 user nova-compute[73091]:   </metadata>
Aug 16 15:22:52 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:22:52 user nova-compute[73091]:     <system>
Aug 16 15:22:52 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:22:52 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:22:52 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:22:52 user nova-compute[73091]:       <entry name="serial">725361f9-395a-4a19-9900-bacbb4315b92</entry>
Aug 16 15:22:52 user nova-compute[73091]:       <entry name="uuid">725361f9-395a-4a19-9900-bacbb4315b92</entry>
Aug 16 15:22:52 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:22:52 user nova-compute[73091]:     </system>
Aug 16 15:22:52 user nova-compute[73091]:   </sysinfo>
Aug 16 15:22:52 user nova-compute[73091]:   <os>
Aug 16 15:22:52 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:22:52 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:22:52 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:22:52 user nova-compute[73091]:   </os>
Aug 16 15:22:52 user nova-compute[73091]:   <features>
Aug 16 15:22:52 user nova-compute[73091]:     <acpi/>
Aug 16 15:22:52 user nova-compute[73091]:     <apic/>
Aug 16 15:22:52 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:22:52 user nova-compute[73091]:   </features>
Aug 16 15:22:52 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:22:52 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:22:52 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:22:52 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:22:52 user nova-compute[73091]:   </clock>
Aug 16 15:22:52 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:22:52 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:22:52 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:22:52 user nova-compute[73091]:   </cpu>
Aug 16 15:22:52 user nova-compute[73091]:   <devices>
Aug 16 15:22:52 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:22:52 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:22:52 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk"/>
Aug 16 15:22:52 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:22:52 user nova-compute[73091]:     </disk>
Aug 16 15:22:52 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:22:52 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:22:52 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:22:52 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:22:52 user nova-compute[73091]:       <serial>366767b6-4587-45a5-89a8-3d2f7455f658</serial>
Aug 16 15:22:52 user nova-compute[73091]:     </disk>
Aug 16 15:22:52 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:22:52 user nova-compute[73091]:       <mac address="fa:16:3e:bd:6c:10"/>
Aug 16 15:22:52 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:22:52 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:22:52 user nova-compute[73091]:       <target dev="tap4c46ede2-2e"/>
Aug 16 15:22:52 user nova-compute[73091]:     </interface>
Aug 16 15:22:52 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:22:52 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/console.log" append="off"/>
Aug 16 15:22:52 user nova-compute[73091]:     </serial>
Aug 16 15:22:52 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:22:52 user nova-compute[73091]:     <video>
Aug 16 15:22:52 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:22:52 user nova-compute[73091]:     </video>
Aug 16 15:22:52 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:22:52 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:22:52 user nova-compute[73091]:     </rng>
Aug 16 15:22:52 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:22:52 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:22:52 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:22:52 user nova-compute[73091]:     </memballoon>
Aug 16 15:22:52 user nova-compute[73091]:   </devices>
Aug 16 15:22:52 user nova-compute[73091]: </domain>
Aug 16 15:22:52 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'trusted_certs' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:22:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Cannot resize image /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'migration_context' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG os_vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c46ede2-2e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c46ede2-2e, col_values=(('external_ids', {'iface-id': '4c46ede2-2e38-4999-aa47-2c7f3a36f65f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:6c:10', 'vm-uuid': '725361f9-395a-4a19-9900-bacbb4315b92'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:53 user nova-compute[73091]: INFO os_vif [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e')
Aug 16 15:22:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b0cbe32-9647-4a69-b479-5330ff369c14 req-e8b00e4c-b8da-4fd5-a722-d99de8594ce6 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b0cbe32-9647-4a69-b479-5330ff369c14 req-e8b00e4c-b8da-4fd5-a722-d99de8594ce6 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b0cbe32-9647-4a69-b479-5330ff369c14 req-e8b00e4c-b8da-4fd5-a722-d99de8594ce6 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b0cbe32-9647-4a69-b479-5330ff369c14 req-e8b00e4c-b8da-4fd5-a722-d99de8594ce6 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b0cbe32-9647-4a69-b479-5330ff369c14 req-e8b00e4c-b8da-4fd5-a722-d99de8594ce6 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:22:54 user nova-compute[73091]: WARNING nova.compute.manager [req-3b0cbe32-9647-4a69-b479-5330ff369c14 req-e8b00e4c-b8da-4fd5-a722-d99de8594ce6 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state stopped and task_state powering-on.
Aug 16 15:22:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:56 user nova-compute[73091]: INFO nova.compute.manager [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] instance snapshotting
Aug 16 15:22:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Beginning live snapshot process
Aug 16 15:22:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199377.0185206, 725361f9-395a-4a19-9900-bacbb4315b92 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:22:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Resumed (Lifecycle Event)
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing instance network info cache due to event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance rebooted successfully.
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f9eaea24-8d37-43dc-a0e6-9ca7ec0d92b9 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:22:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199377.0226722, 725361f9-395a-4a19-9900-bacbb4315b92 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:22:57 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Started (Lifecycle Event)
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4zcd56gu/1ed16eb53cc541bcb22add5df2cd345d.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4zcd56gu/1ed16eb53cc541bcb22add5df2cd345d.delta 1073741824" returned: 0 in 0.068s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updated VIF entry in instance network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:22:57 user nova-compute[73091]: WARNING nova.compute.manager [req-8ac6a7a9-9b07-4f39-a9e0-aa2bb0d26543 req-863ec8f2-0389-45f9-8e74-7ac29f6b1110 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state stopped and task_state powering-on.
Aug 16 15:22:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:22:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:22:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] COPY block job progress, current cursor: 15597568 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:22:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 15:22:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 15:22:59 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:22:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4zcd56gu/1ed16eb53cc541bcb22add5df2cd345d.delta /opt/stack/data/nova/instances/snapshots/tmp4zcd56gu/1ed16eb53cc541bcb22add5df2cd345d {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:22:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4zcd56gu/1ed16eb53cc541bcb22add5df2cd345d.delta /opt/stack/data/nova/instances/snapshots/tmp4zcd56gu/1ed16eb53cc541bcb22add5df2cd345d" returned: 0 in 0.612s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:22:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Snapshot extracted, beginning image upload
Aug 16 15:23:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Snapshot image upload complete
Aug 16 15:23:02 user nova-compute[73091]: INFO nova.compute.manager [None req-4ba8cde7-77ce-4b07-9485-42292902e4aa tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Took 6.44 seconds to snapshot the instance on the hypervisor.
Aug 16 15:23:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-changed-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Refreshing instance network info cache due to event network-changed-ec62d487-db27-40ca-a517-0ef6660e8d57. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] Acquiring lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] Acquired lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Refreshing network info cache for port ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updated VIF entry in instance network info cache for port ec62d487-db27-40ca-a517-0ef6660e8d57. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updating instance_info_cache with network_info: [{"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:23:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f52df13e-4f2f-4d4b-a1fe-2dbf72e98230 req-c113e30f-396f-43e9-ad3f-33091cad958f service nova] Releasing lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:23:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b0283440-ab93-45d9-83aa-9ac990702e40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:23:15 user nova-compute[73091]: INFO nova.compute.claims [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Claim successful on node user
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:23:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:23:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:23:16 user nova-compute[73091]: INFO nova.virt.block_device [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Booting with volume snapshot 3954e4a4-0cea-4b12-85d2-bc967711b049 at /dev/vda
Aug 16 15:23:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:16 user nova-compute[73091]: DEBUG nova.policy [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab71a5471a4bbcb7845d1293849449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f7da218a484e86a7c25626b2e178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:23:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Successfully created port: 4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Successfully updated port: 4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquired lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-changed-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Refreshing instance network info cache due to event network-changed-4d42aa1e-aff7-4892-926b-fd8449c721c5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] Acquiring lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updating instance_info_cache with network_info: [{"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Releasing lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Instance network_info: |[{"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] Acquired lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Refreshing network info cache for port 4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:23:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updated VIF entry in instance network info cache for port 4d42aa1e-aff7-4892-926b-fd8449c721c5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updating instance_info_cache with network_info: [{"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa25ec40-52c2-4071-9c18-fee36ae7c607 req-f48633e9-1ed8-4f36-b6ce-9e8296bef4b2 service nova] Releasing lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:23:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=25.28180694580078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b398d826-b534-4101-9d17-5e5d687afb57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9dda7814-70fc-4b22-96d4-a64a10e86c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b0283440-ab93-45d9-83aa-9ac990702e40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:23:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34284891-0b49-4404-8542-dc6e6e8fd664]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af0c40-e8cf-4023-8d35-2cb8dd1408fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069c111-ea4c-479e-8e30-afbd5bc43538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc9fc7-9a5a-4058-b265-fc326c2dcff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:23:22 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:23:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb142832-05ad-4ee1-88dd-5870277f849a]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:23:22 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updating existing volume attachment record: 37ab1d16-43a0-4b18-875f-de3a1f3c2e12 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:23:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:23:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:23:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Creating image(s)
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Ensure instance console log exists: /opt/stack/data/nova/instances/b0283440-ab93-45d9-83aa-9ac990702e40/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Start _get_guest_xml network_info=[{"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T15:23:05Z,direct_url=<?>,disk_format='qcow2',id=dae2225a-d046-4a65-a9f7-39c2dcff0c70,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-37994510',owner='1236f7da218a484e86a7c25626b2e178',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T15:23:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '37ab1d16-43a0-4b18-875f-de3a1f3c2e12', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRaEJMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0283440-ab93-45d9-83aa-9ac990702e40', 'attached_at': '', 'detached_at': '', 'volume_id': 'efc942e1-1a86-4227-a21b-655969481500', 'serial': 'efc942e1-1a86-4227-a21b-655969481500'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:23:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:23:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T15:23:05Z,direct_url=<?>,disk_format='qcow2',id=dae2225a-d046-4a65-a9f7-39c2dcff0c70,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-37994510',owner='1236f7da218a484e86a7c25626b2e178',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T15:23:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRaEJMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:23:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:23:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:23:32 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[105dd518-9903-418e-9c16-db2b78e7c4db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:23:32 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68b7298-7609-472c-87e4-ed38657ee555]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500] added
Aug 16 15:23:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4951050-5f1d-4ad8-bb8a-37d5e923f53d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81737387-1edb-41e5-bc26-70bc119c6022]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btRaEJMX {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btRaEJMX" returned: 0 in 0.091s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f60ff7-8c35-4764-9dcc-0f78f094d343]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btRaEJMX'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c3e10-5951-48b8-bb16-cac5c7d0aa46]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd10ca3-b891-4c51-9309-de86ee86aa75]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5064671-a562-490b-88ca-29cf8f8433ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260]
Aug 16 15:23:33 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260] successful.
Aug 16 15:23:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba5b97-3a40-4cca-9b22-33d5f61ed8a4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba91eb1-80fc-4c5b-8dd3-a6f4bfe9398b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:23:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08426fc-b7f0-4b39-b02a-2048d4bc0162]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRaEJMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:23:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26463383064363638', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383064363638', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1959894712',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1959894712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1959894712',id=41,image_ref='dae2225a-d046-4a65-a9f7-39c2dcff0c70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/YEiEuRF8M0L/snaK/ItNhiG/b5TmbDn8BlRMbWXNf7/R9jIeJAa8wkkZsioAdDY1eCy648FCFdlhnyqlBGNRIgM+g8XFQuTfGgeTkJemwrtDYqJfDCn0HBpUi59Xl5Q==',key_name='tempest-keypair-973459494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-g0dkcgjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1172028538',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=b0283440-ab93-45d9-83aa-9ac990702e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'pci_devices' on Instance uuid b0283440-ab93-45d9-83aa-9ac990702e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:23:34 user nova-compute[73091]:   <uuid>b0283440-ab93-45d9-83aa-9ac990702e40</uuid>
Aug 16 15:23:34 user nova-compute[73091]:   <name>instance-00000029</name>
Aug 16 15:23:34 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:23:34 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:23:34 user nova-compute[73091]:   <metadata>
Aug 16 15:23:34 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:23:34 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:23:34 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1959894712</nova:name>
Aug 16 15:23:34 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:23:32</nova:creationTime>
Aug 16 15:23:34 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:23:34 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:23:34 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:23:34 user nova-compute[73091]:       <nova:owner>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:user uuid="b8ab71a5471a4bbcb7845d1293849449">tempest-TestVolumeBootPattern-1172028538-project-member</nova:user>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:project uuid="1236f7da218a484e86a7c25626b2e178">tempest-TestVolumeBootPattern-1172028538</nova:project>
Aug 16 15:23:34 user nova-compute[73091]:       </nova:owner>
Aug 16 15:23:34 user nova-compute[73091]:       <nova:root type="image" uuid="dae2225a-d046-4a65-a9f7-39c2dcff0c70"/>
Aug 16 15:23:34 user nova-compute[73091]:       <nova:ports>
Aug 16 15:23:34 user nova-compute[73091]:         <nova:port uuid="4d42aa1e-aff7-4892-926b-fd8449c721c5">
Aug 16 15:23:34 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 15:23:34 user nova-compute[73091]:         </nova:port>
Aug 16 15:23:34 user nova-compute[73091]:       </nova:ports>
Aug 16 15:23:34 user nova-compute[73091]:     </nova:instance>
Aug 16 15:23:34 user nova-compute[73091]:   </metadata>
Aug 16 15:23:34 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:23:34 user nova-compute[73091]:     <system>
Aug 16 15:23:34 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:23:34 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:23:34 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:23:34 user nova-compute[73091]:       <entry name="serial">b0283440-ab93-45d9-83aa-9ac990702e40</entry>
Aug 16 15:23:34 user nova-compute[73091]:       <entry name="uuid">b0283440-ab93-45d9-83aa-9ac990702e40</entry>
Aug 16 15:23:34 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:23:34 user nova-compute[73091]:     </system>
Aug 16 15:23:34 user nova-compute[73091]:   </sysinfo>
Aug 16 15:23:34 user nova-compute[73091]:   <os>
Aug 16 15:23:34 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:23:34 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:23:34 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:23:34 user nova-compute[73091]:   </os>
Aug 16 15:23:34 user nova-compute[73091]:   <features>
Aug 16 15:23:34 user nova-compute[73091]:     <acpi/>
Aug 16 15:23:34 user nova-compute[73091]:     <apic/>
Aug 16 15:23:34 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:23:34 user nova-compute[73091]:   </features>
Aug 16 15:23:34 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:23:34 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:23:34 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:23:34 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:23:34 user nova-compute[73091]:   </clock>
Aug 16 15:23:34 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:23:34 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:23:34 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:23:34 user nova-compute[73091]:   </cpu>
Aug 16 15:23:34 user nova-compute[73091]:   <devices>
Aug 16 15:23:34 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:23:34 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:23:34 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 15:23:34 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:23:34 user nova-compute[73091]:       <serial>efc942e1-1a86-4227-a21b-655969481500</serial>
Aug 16 15:23:34 user nova-compute[73091]:     </disk>
Aug 16 15:23:34 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:23:34 user nova-compute[73091]:       <mac address="fa:16:3e:e6:94:72"/>
Aug 16 15:23:34 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:23:34 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:23:34 user nova-compute[73091]:       <target dev="tap4d42aa1e-af"/>
Aug 16 15:23:34 user nova-compute[73091]:     </interface>
Aug 16 15:23:34 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:23:34 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b0283440-ab93-45d9-83aa-9ac990702e40/console.log" append="off"/>
Aug 16 15:23:34 user nova-compute[73091]:     </serial>
Aug 16 15:23:34 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:23:34 user nova-compute[73091]:     <video>
Aug 16 15:23:34 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:23:34 user nova-compute[73091]:     </video>
Aug 16 15:23:34 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:23:34 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:23:34 user nova-compute[73091]:     </rng>
Aug 16 15:23:34 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:23:34 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:23:34 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:23:34 user nova-compute[73091]:     </memballoon>
Aug 16 15:23:34 user nova-compute[73091]:   </devices>
Aug 16 15:23:34 user nova-compute[73091]: </domain>
Aug 16 15:23:34 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1959894712',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1959894712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1959894712',id=41,image_ref='dae2225a-d046-4a65-a9f7-39c2dcff0c70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/YEiEuRF8M0L/snaK/ItNhiG/b5TmbDn8BlRMbWXNf7/R9jIeJAa8wkkZsioAdDY1eCy648FCFdlhnyqlBGNRIgM+g8XFQuTfGgeTkJemwrtDYqJfDCn0HBpUi59Xl5Q==',key_name='tempest-keypair-973459494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-g0dkcgjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1172028538',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=b0283440-ab93-45d9-83aa-9ac990702e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG os_vif [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d42aa1e-af, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d42aa1e-af, col_values=(('external_ids', {'iface-id': '4d42aa1e-aff7-4892-926b-fd8449c721c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:94:72', 'vm-uuid': 'b0283440-ab93-45d9-83aa-9ac990702e40'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:34 user nova-compute[73091]: INFO os_vif [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af')
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No VIF found with MAC fa:16:3e:e6:94:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-changed-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Refreshing instance network info cache due to event network-changed-52e44f39-a69e-49e9-9e72-013b63cdf1f9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] Acquiring lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] Acquired lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Refreshing network info cache for port 52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updated VIF entry in instance network info cache for port 52e44f39-a69e-49e9-9e72-013b63cdf1f9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:23:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:23:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-041756ee-82aa-47e5-870e-5f1255a5406f req-c7e05506-4222-4f91-bbd0-af7a800b010c service nova] Releasing lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-7393d5aa-3325-45b1-bbe4-08916c1ff9c6 req-614401b9-3f83-4413-b37b-76574951c499 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7393d5aa-3325-45b1-bbe4-08916c1ff9c6 req-614401b9-3f83-4413-b37b-76574951c499 service nova] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7393d5aa-3325-45b1-bbe4-08916c1ff9c6 req-614401b9-3f83-4413-b37b-76574951c499 service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7393d5aa-3325-45b1-bbe4-08916c1ff9c6 req-614401b9-3f83-4413-b37b-76574951c499 service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-7393d5aa-3325-45b1-bbe4-08916c1ff9c6 req-614401b9-3f83-4413-b37b-76574951c499 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] No waiting events found dispatching network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:23:36 user nova-compute[73091]: WARNING nova.compute.manager [req-7393d5aa-3325-45b1-bbe4-08916c1ff9c6 req-614401b9-3f83-4413-b37b-76574951c499 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received unexpected event network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 for instance with vm_state building and task_state spawning.
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199417.846937, b0283440-ab93-45d9-83aa-9ac990702e40 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:23:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] VM Resumed (Lifecycle Event)
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:23:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Instance spawned successfully.
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:23:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199417.8492959, b0283440-ab93-45d9-83aa-9ac990702e40 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:23:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] VM Started (Lifecycle Event)
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:23:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 16 15:23:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:23:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:23:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Took 22.17 seconds to build instance.
Aug 16 15:23:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f20a001b-64e4-4adb-adaa-a3a61b1d713d tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b0283440-ab93-45d9-83aa-9ac990702e40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.295s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c3500ca-925b-4d50-ace1-dafb991dad82 req-e0279e96-7a8f-4349-9b5c-425d695caffe service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:23:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c3500ca-925b-4d50-ace1-dafb991dad82 req-e0279e96-7a8f-4349-9b5c-425d695caffe service nova] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c3500ca-925b-4d50-ace1-dafb991dad82 req-e0279e96-7a8f-4349-9b5c-425d695caffe service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c3500ca-925b-4d50-ace1-dafb991dad82 req-e0279e96-7a8f-4349-9b5c-425d695caffe service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c3500ca-925b-4d50-ace1-dafb991dad82 req-e0279e96-7a8f-4349-9b5c-425d695caffe service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] No waiting events found dispatching network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:23:38 user nova-compute[73091]: WARNING nova.compute.manager [req-1c3500ca-925b-4d50-ace1-dafb991dad82 req-e0279e96-7a8f-4349-9b5c-425d695caffe service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received unexpected event network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 for instance with vm_state active and task_state None.
Aug 16 15:23:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:23:40 user nova-compute[73091]: INFO nova.compute.manager [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attaching volume 1ad0dcbb-3eae-4f23-bf4f-952ef66441dc to /dev/vdb
Aug 16 15:23:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[12407cb7-9d0e-4a2e-8d96-b5586a2d669e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522a433-46a2-4cf1-b0d7-9819d5b06dd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c04dc8-154a-4576-9bc8-0bfc5f8c00a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dab823-b10b-4a0a-87fd-ba962c630606]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:23:40 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:23:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133386f-4bb2-49ed-80e2-3f22c5c88449]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:23:40 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating existing volume attachment record: ef12653d-000a-46dc-a52e-b2c13a855a27 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:23:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNtTUGkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:23:51 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:23:51 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:23:51 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04f999e-f500-41db-b920-5d9809bacbb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:23:51 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[616cb8fd-2127-4b11-97aa-9e8c52b815e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc] added
Aug 16 15:23:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab50b4-328a-4f6d-9e55-41f5da66a93d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88fc81e-712a-44b6-8ab2-1c7d2ee9d3f6]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNtTUGkr {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNtTUGkr" returned: 0 in 0.090s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7536436-7720-4793-9226-df27808e000e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xNtTUGkr'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b1b93-b53f-46a2-9064-895cdb953c2d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b00ea-cba1-4416-95ea-978d1df735fb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b4d5ea-eb97-42de-892a-f4441b7f4b75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260]
Aug 16 15:23:51 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260] successful.
Aug 16 15:23:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[252edfe2-76eb-44c2-878d-38258ae82e12]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa2d1ee-f38c-4c47-9fed-ccff48c1d96d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc (non-flash)
Aug 16 15:23:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:23:51 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc (non-flash)
Aug 16 15:23:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1944a60-efc4-47a8-a39b-bedb0970cd2e]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:23:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:23:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:23:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNtTUGkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:23:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:23:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23234626635616263', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:23:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626635616263', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:23:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:23:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:23:53 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:23:53 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:23:53 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:23:53 user nova-compute[73091]:   <serial>1ad0dcbb-3eae-4f23-bf4f-952ef66441dc</serial>
Aug 16 15:23:53 user nova-compute[73091]: </disk>
Aug 16 15:23:53 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:23:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:23:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:23:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No VIF found with MAC fa:16:3e:04:22:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:23:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12d58fba-dca1-4171-8716-a0894c753681 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.081s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:23:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:23:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:24:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:24:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:24:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=25.262958526611328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b398d826-b534-4101-9d17-5e5d687afb57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 9dda7814-70fc-4b22-96d4-a64a10e86c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b0283440-ab93-45d9-83aa-9ac990702e40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:24:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:22 user nova-compute[73091]: INFO nova.compute.manager [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Terminating instance
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ccc8fd4-38a1-43f3-af4e-7c3a0092b48f req-175ae627-6546-4012-ab91-71030a5ea2d6 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-vif-unplugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ccc8fd4-38a1-43f3-af4e-7c3a0092b48f req-175ae627-6546-4012-ab91-71030a5ea2d6 service nova] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ccc8fd4-38a1-43f3-af4e-7c3a0092b48f req-175ae627-6546-4012-ab91-71030a5ea2d6 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ccc8fd4-38a1-43f3-af4e-7c3a0092b48f req-175ae627-6546-4012-ab91-71030a5ea2d6 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ccc8fd4-38a1-43f3-af4e-7c3a0092b48f req-175ae627-6546-4012-ab91-71030a5ea2d6 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] No waiting events found dispatching network-vif-unplugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ccc8fd4-38a1-43f3-af4e-7c3a0092b48f req-175ae627-6546-4012-ab91-71030a5ea2d6 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-vif-unplugged-53713020-c858-48dd-bb8e-d2bf140b00d2 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Instance destroyed successfully.
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lazy-loading 'resources' on Instance uuid 9dda7814-70fc-4b22-96d4-a64a10e86c1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-403565502',display_name='tempest-VolumesNegativeTest-instance-403565502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-403565502',id=40,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:22:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce1546518eb404e936a10c62da3866f',ramdisk_id='',reservation_id='r-i74j35s1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-995518035',owner_user_name='tempest-VolumesNegativeTest-995518035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:22:39Z,user_data=None,user_id='ea0797ada164408eb2c51f4d415c7d17',uuid=9dda7814-70fc-4b22-96d4-a64a10e86c1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Converting VIF {"id": "53713020-c858-48dd-bb8e-d2bf140b00d2", "address": "fa:16:3e:6f:69:a1", "network": {"id": "64901d78-1918-4311-9d4a-4d441285499c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "aa21f859d9f845088f11b1cc8fa21131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53713020-c8", "ovs_interfaceid": "53713020-c858-48dd-bb8e-d2bf140b00d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG os_vif [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53713020-c8, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:22 user nova-compute[73091]: INFO os_vif [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:69:a1,bridge_name='br-int',has_traffic_filtering=True,id=53713020-c858-48dd-bb8e-d2bf140b00d2,network=Network(64901d78-1918-4311-9d4a-4d441285499c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53713020-c8')
Aug 16 15:24:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Deleting instance files /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b_del
Aug 16 15:24:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Deletion of /opt/stack/data/nova/instances/9dda7814-70fc-4b22-96d4-a64a10e86c1b_del complete
Aug 16 15:24:22 user nova-compute[73091]: INFO nova.compute.manager [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 16 15:24:22 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:24:22 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:24:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Took 0.43 seconds to deallocate network for instance.
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-f176dc18-68cb-412a-8404-764d89702b2e req-84d5ccdd-ae33-4ae4-8a61-1f2a4b221a00 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-vif-deleted-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:23 user nova-compute[73091]: INFO nova.compute.manager [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Detaching volume 1ad0dcbb-3eae-4f23-bf4f-952ef66441dc
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:24:23 user nova-compute[73091]: INFO nova.virt.block_device [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attempting to driver detach volume 1ad0dcbb-3eae-4f23-bf4f-952ef66441dc from mountpoint /dev/vdb
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Attempting to detach device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:24:23 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:24:23 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:24:23 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:24:23 user nova-compute[73091]:   <serial>1ad0dcbb-3eae-4f23-bf4f-952ef66441dc</serial>
Aug 16 15:24:23 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:24:23 user nova-compute[73091]: </disk>
Aug 16 15:24:23 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:24:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config.
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:24:23 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:24:23 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:24:23 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:24:23 user nova-compute[73091]:   <serial>1ad0dcbb-3eae-4f23-bf4f-952ef66441dc</serial>
Aug 16 15:24:23 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:24:23 user nova-compute[73091]: </disk>
Aug 16 15:24:23 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:23 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Deleted allocations for instance 9dda7814-70fc-4b22-96d4-a64a10e86c1b
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b2eddd0-a2f2-4f52-9b1f-728362e197e1 tempest-VolumesNegativeTest-995518035 tempest-VolumesNegativeTest-995518035-project-member] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.552s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updating instance_info_cache with network_info: [{"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b398d826-b534-4101-9d17-5e5d687afb57" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:24:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199464.0566254, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:24:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config.
Aug 16 15:24:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNtTUGkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:24:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a04a2e-dc42-4d81-9ae4-777cf7c3c4ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c030b1-953f-46a2-8d96-143d7afa5d89]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:24 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:24:24 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:24 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc (non-flash)
Aug 16 15:24:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:24 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:24:24 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:24 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc (non-flash)
Aug 16 15:24:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c3a95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8692fb-a89b-4d89-b1db-0b5f96e1febf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c0f60-cf62-47d2-b7b7-f327fbabb851]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a09d5-2438-49b2-a829-a39a8ad13438]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c6547-9267-4ada-b387-988720a1c22e]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac96b1c-2d7b-498e-a642-ebfd084c7139]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8d642-ac44-40b9-949c-89e753a1af1f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260]
Aug 16 15:24:24 user nova-compute[73091]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc, portal: 172.16.0.220,3260] successful.
Aug 16 15:24:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad0dcbb-3eae-4f23-bf4f-952ef66441dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c435c2bf-d306-4afa-9d30-244c80aa6f45]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== disconnect_volume: return (287ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-44574a1c-795f-4149-8e06-6efe210e1eb0 req-af271ac8-9b94-47d3-8717-22122f12ca90 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received event network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-44574a1c-795f-4149-8e06-6efe210e1eb0 req-af271ac8-9b94-47d3-8717-22122f12ca90 service nova] Acquiring lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-44574a1c-795f-4149-8e06-6efe210e1eb0 req-af271ac8-9b94-47d3-8717-22122f12ca90 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-44574a1c-795f-4149-8e06-6efe210e1eb0 req-af271ac8-9b94-47d3-8717-22122f12ca90 service nova] Lock "9dda7814-70fc-4b22-96d4-a64a10e86c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-44574a1c-795f-4149-8e06-6efe210e1eb0 req-af271ac8-9b94-47d3-8717-22122f12ca90 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] No waiting events found dispatching network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:24:24 user nova-compute[73091]: WARNING nova.compute.manager [req-44574a1c-795f-4149-8e06-6efe210e1eb0 req-af271ac8-9b94-47d3-8717-22122f12ca90 service nova] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Received unexpected event network-vif-plugged-53713020-c858-48dd-bb8e-d2bf140b00d2 for instance with vm_state deleted and task_state None.
Aug 16 15:24:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:24:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d17f1c9e-ee44-47e9-9401-4b61da5502a2 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:24:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:24:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199462.8733814, 9dda7814-70fc-4b22-96d4-a64a10e86c1b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:24:37 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] VM Stopped (Lifecycle Event)
Aug 16 15:24:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d896ae5-6d78-4503-ae96-775791540821 None None] [instance: 9dda7814-70fc-4b22-96d4-a64a10e86c1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:24:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:41 user nova-compute[73091]: INFO nova.compute.manager [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Detaching volume 366767b6-4587-45a5-89a8-3d2f7455f658
Aug 16 15:24:41 user nova-compute[73091]: INFO nova.virt.block_device [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Attempting to driver detach volume 366767b6-4587-45a5-89a8-3d2f7455f658 from mountpoint /dev/vdb
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Attempting to detach device vdb from instance 725361f9-395a-4a19-9900-bacbb4315b92 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:24:41 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:24:41 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:24:41 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:24:41 user nova-compute[73091]:   <serial>366767b6-4587-45a5-89a8-3d2f7455f658</serial>
Aug 16 15:24:41 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:24:41 user nova-compute[73091]: </disk>
Aug 16 15:24:41 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:24:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully detached device vdb from instance 725361f9-395a-4a19-9900-bacbb4315b92 from the persistent domain config.
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 725361f9-395a-4a19-9900-bacbb4315b92 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:24:41 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:24:41 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:24:41 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:24:41 user nova-compute[73091]:   <serial>366767b6-4587-45a5-89a8-3d2f7455f658</serial>
Aug 16 15:24:41 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 15:24:41 user nova-compute[73091]: </disk>
Aug 16 15:24:41 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199481.6107843, 725361f9-395a-4a19-9900-bacbb4315b92 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:24:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully detached device vdb from instance 725361f9-395a-4a19-9900-bacbb4315b92 from the live domain config.
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAOEMbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:24:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f10b5e-26a5-4583-af23-110b863357a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e17f927-059c-4530-8ffb-08521e2f7fba]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:41 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:24:41 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:41 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 (non-flash)
Aug 16 15:24:41 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c5489d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ecb375-bd9c-4ddf-ada3-b7a1c45938ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07bfd23-f621-4ffb-9c54-c4f6fc689ac1]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1301d4d7-ced5-413f-b1d7-edffe92bb4b4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe42c4-4265-4307-85da-08203f999af3]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a885a8-7253-495a-be59-ad73495fbf62]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbcabf8-55d7-49b1-a5ad-6679dfcf04e4]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260]
Aug 16 15:24:41 user nova-compute[73091]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658, portal: 172.16.0.220,3260] successful.
Aug 16 15:24:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366767b6-4587-45a5-89a8-3d2f7455f658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0dd2c-9229-4411-adac-4013ba7b2617]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== disconnect_volume: return (283ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:24:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:24:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:24:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ee294dfb-3410-4fe9-8322-c948614c223b tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73091) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-9822e6f1-6169-434a-9890-4ad3b10990d3 req-3846c343-fcc8-44cd-ad2e-74d5f9685473 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9822e6f1-6169-434a-9890-4ad3b10990d3 req-3846c343-fcc8-44cd-ad2e-74d5f9685473 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9822e6f1-6169-434a-9890-4ad3b10990d3 req-3846c343-fcc8-44cd-ad2e-74d5f9685473 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9822e6f1-6169-434a-9890-4ad3b10990d3 req-3846c343-fcc8-44cd-ad2e-74d5f9685473 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-9822e6f1-6169-434a-9890-4ad3b10990d3 req-3846c343-fcc8-44cd-ad2e-74d5f9685473 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:24:43 user nova-compute[73091]: WARNING nova.compute.manager [req-9822e6f1-6169-434a-9890-4ad3b10990d3 req-3846c343-fcc8-44cd-ad2e-74d5f9685473 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state active and task_state powering-off.
Aug 16 15:24:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance destroyed successfully.
Aug 16 15:24:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:24:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ae84261-7f92-4443-965d-565e291684a5 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.826s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-53ea4562-8840-4d5b-af2e-56840f9a530f req-ba571027-068c-41c7-b103-f61c084e9244 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:24:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53ea4562-8840-4d5b-af2e-56840f9a530f req-ba571027-068c-41c7-b103-f61c084e9244 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53ea4562-8840-4d5b-af2e-56840f9a530f req-ba571027-068c-41c7-b103-f61c084e9244 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53ea4562-8840-4d5b-af2e-56840f9a530f req-ba571027-068c-41c7-b103-f61c084e9244 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-53ea4562-8840-4d5b-af2e-56840f9a530f req-ba571027-068c-41c7-b103-f61c084e9244 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:24:45 user nova-compute[73091]: WARNING nova.compute.manager [req-53ea4562-8840-4d5b-af2e-56840f9a530f req-ba571027-068c-41c7-b103-f61c084e9244 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state stopped and task_state None.
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'flavor' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:24:47 user nova-compute[73091]: INFO nova.compute.manager [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Attaching volume 9c999f73-53f5-4275-81b1-2d6606f1f81b to /dev/vdb
Aug 16 15:24:47 user nova-compute[73091]: DEBUG os_brick.utils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0049c1-9b04-416c-8a5d-43cee96d8f95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca435d3-d02b-414b-9104-7a1dc8e2408d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b87f60-6726-49b4-bdb5-0a3450434313]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46247125-9d8c-4b0b-8d43-70acdd1d2d08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:24:47 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:24:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1caabd-127d-432a-8d52-9a845ea66716]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG os_brick.utils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating existing volume attachment record: e1812ffb-120d-46d7-a98d-336e9e082d92 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:24:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgwbnKoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:24:57 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:24:57 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:24:57 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e41636c-2331-4332-802c-0116a0a95be7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:24:57 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b53145-64a4-4a20-b898-38f4f22c5fbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b] added
Aug 16 15:24:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6fd83-e3d7-4286-ba08-c22ed29aefc2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad1ff43-0285-453b-884b-25d28c7ad52b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgwbnKoW {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgwbnKoW" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b988e98f-9ff1-4a0c-9018-9cb4c4d824a2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kgwbnKoW'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0f752-edc5-48b2-9dbe-70bb6f1eff5b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bfc735-f265-49ad-83a7-9f7ee0a1dc91]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c125c9-d257-4ac9-9a3c-4c457bfd7d6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260]
Aug 16 15:24:57 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260] successful.
Aug 16 15:24:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b30f71-2b2f-4ed4-a169-11a67979d19b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac3183-ca65-4044-8f6b-6e27cdb753bd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:24:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:24:57 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:24:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:24:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:24:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:24:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a810811-33f5-4254-a67c-84b09deda4ef]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:24:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:24:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgwbnKoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23761633031303962', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761633031303962', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'flavor' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:24:59 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:24:59 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:24:59 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:24:59 user nova-compute[73091]:   <serial>9c999f73-53f5-4275-81b1-2d6606f1f81b</serial>
Aug 16 15:24:59 user nova-compute[73091]: </disk>
Aug 16 15:24:59 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199484.1336112, 725361f9-395a-4a19-9900-bacbb4315b92 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:24:59 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Stopped (Lifecycle Event)
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2972b887-d3c0-453c-a2b2-adc62656130b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2972b887-d3c0-453c-a2b2-adc62656130b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No VIF found with MAC fa:16:3e:94:6d:81, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:24:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7425bd2-4c16-452f-a95c-33651adaf073 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.075s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:00 user nova-compute[73091]: INFO nova.compute.manager [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Rescuing
Aug 16 15:25:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:25:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:25:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bf0689b-bcfa-4a61-a3de-0e65fc550e1c req-d18dd9bc-0f1f-41b7-9338-2ce21b0df00d service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bf0689b-bcfa-4a61-a3de-0e65fc550e1c req-d18dd9bc-0f1f-41b7-9338-2ce21b0df00d service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bf0689b-bcfa-4a61-a3de-0e65fc550e1c req-d18dd9bc-0f1f-41b7-9338-2ce21b0df00d service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bf0689b-bcfa-4a61-a3de-0e65fc550e1c req-d18dd9bc-0f1f-41b7-9338-2ce21b0df00d service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bf0689b-bcfa-4a61-a3de-0e65fc550e1c req-d18dd9bc-0f1f-41b7-9338-2ce21b0df00d service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:25:01 user nova-compute[73091]: WARNING nova.compute.manager [req-8bf0689b-bcfa-4a61-a3de-0e65fc550e1c req-d18dd9bc-0f1f-41b7-9338-2ce21b0df00d service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state active and task_state rescuing.
Aug 16 15:25:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance destroyed successfully.
Aug 16 15:25:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Attempting a stable device rescue
Aug 16 15:25:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 15:25:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Creating image(s)
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.part --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG nova.virt.images [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] 341eb3e8-7dcf-4c3e-b833-dd7f0ba27033 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.part /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-494fc3bc-7068-4329-a907-e81c364322ce req-5a66a7be-a715-4a41-b372-b01abf996f78 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-494fc3bc-7068-4329-a907-e81c364322ce req-5a66a7be-a715-4a41-b372-b01abf996f78 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-494fc3bc-7068-4329-a907-e81c364322ce req-5a66a7be-a715-4a41-b372-b01abf996f78 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-494fc3bc-7068-4329-a907-e81c364322ce req-5a66a7be-a715-4a41-b372-b01abf996f78 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-494fc3bc-7068-4329-a907-e81c364322ce req-5a66a7be-a715-4a41-b372-b01abf996f78 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:25:03 user nova-compute[73091]: WARNING nova.compute.manager [req-494fc3bc-7068-4329-a907-e81c364322ce req-5a66a7be-a715-4a41-b372-b01abf996f78 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state active and task_state rescuing.
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.part /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.converted" returned: 0 in 0.705s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.120s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b,backing_fmt=raw /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b,backing_fmt=raw /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue" returned: 0 in 0.055s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'migration_context' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Start _get_guest_xml network_info=[{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "vif_mac": "fa:16:3e:94:6d:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '341eb3e8-7dcf-4c3e-b833-dd7f0ba27033', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'e1812ffb-120d-46d7-a98d-336e9e082d92', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgwbnKoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e7594dba-8a65-425f-9b10-35b9a0c5e57a', 'attached_at': '', 'detached_at': '', 'volume_id': '9c999f73-53f5-4275-81b1-2d6606f1f81b', 'serial': '9c999f73-53f5-4275-81b1-2d6606f1f81b'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'resources' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'numa_topology' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:25:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgwbnKoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:25:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:25:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:25:04 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec461b-9b16-4d43-b2e9-00dfac7f05b5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kgwbnKoW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 15:25:04 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b
Aug 16 15:25:04 user nova-compute[73091]: node.tpgt = -1
Aug 16 15:25:04 user nova-compute[73091]: node.startup = automatic
Aug 16 15:25:04 user nova-compute[73091]: node.leading_login = No
Aug 16 15:25:04 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 16 15:25:04 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.prefix_len = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.transport_name = tcp
Aug 16 15:25:04 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.vlan_id = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.vlan_priority = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.iface_num = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.mtu = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.port = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.bootproto = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.gateway = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.tos_state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.tos = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.ttl = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.redirect = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.header_digest = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.data_digest = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.erl = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.first_burst_len = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.max_burst_len = 0
Aug 16 15:25:04 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 16 15:25:04 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 16 15:25:04 user nova-compute[73091]: node.discovery_address = <empty>
Aug 16 15:25:04 user nova-compute[73091]: node.discovery_port = 0
Aug 16 15:25:04 user nova-compute[73091]: node.discovery_type = static
Aug 16 15:25:04 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 16 15:25:04 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 16 15:25:04 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 16 15:25:04 user nova-compute[73091]: node.session.cmds_max = 128
Aug 16 15:25:04 user nova-compute[73091]: node.session.queue_depth = 32
Aug 16 15:25:04 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 16 15:25:04 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 16 15:25:04 user nova-compute[73091]: node.session.auth.username = kgwbnKoW
Aug 16 15:25:04 user nova-compute[73091]: node.session.auth.password = ***
Aug 16 15:25:04 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 16 15:25:04 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 16 15:25:04 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 16 15:25:04 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 16 15:25:04 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 16 15:25:04 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 15:25:04 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 15:25:04 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 15:25:04 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 16 15:25:04 user nova-compute[73091]: node.session.scan = manual
Aug 16 15:25:04 user nova-compute[73091]: node.session.reopen_max = 0
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].port = 3260
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].startup = manual
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 16 15:25:04 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 16 15:25:04 user nova-compute[73091]: # END RECORD
Aug 16 15:25:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4fa024-eac0-4064-a8c8-31cbf70feddc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd0ed58-58dc-41b8-bbbf-fdfb84ff979f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgwbnKoW {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgwbnKoW" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef64c2f-0b6a-4b42-b975-ab34ad84c14a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kgwbnKoW'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd64f2b-521e-4ac4-872f-36db32033936]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c53646-8a29-4e36-a8c2-5735cdee0666]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:04 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:25:04 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:04 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:25:04 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] HCTL ('33', '0', '0', 0) found on session 48 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3818f60d-453d-41e7-93e2-6f0f05678710]: (4, ('0 0 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Searching for a device in session 48 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgwbnKoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.158s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] <== connect_volume: return (159ms) {'type': 'block', 'scsi_wwn': '23761633031303962', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761633031303962', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743738867',display_name='tempest-ServerStableDeviceRescueTest-server-1743738867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743738867',id=37,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa8h6cYvARfUqCV5JdjI6N0GPeWXt+eZwXI0stiH6F3WtxolVkANJ+wPxa4xuPVG9+smlfFXwmMkYw7q8Bhq7jnUPNjQRLTfqyIF3ty0Y1pQOE6gS5oF9+ZgUCbEBxODg==',key_name='tempest-keypair-2017314564',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='864a6fc58ffc491aa91905472cca305b',ramdisk_id='',reservation_id='r-wttbpe4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1149513869',owner_user_name='tempest-ServerStableDeviceRescueTest-1149513869-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95fc30b3405462fa36a3851ca239445',uuid=e7594dba-8a65-425f-9b10-35b9a0c5e57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "vif_mac": "fa:16:3e:94:6d:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converting VIF {"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "vif_mac": "fa:16:3e:94:6d:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'pci_devices' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:25:04 user nova-compute[73091]:   <uuid>e7594dba-8a65-425f-9b10-35b9a0c5e57a</uuid>
Aug 16 15:25:04 user nova-compute[73091]:   <name>instance-00000025</name>
Aug 16 15:25:04 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:25:04 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:25:04 user nova-compute[73091]:   <metadata>
Aug 16 15:25:04 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:25:04 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:25:04 user nova-compute[73091]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1743738867</nova:name>
Aug 16 15:25:04 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:25:04</nova:creationTime>
Aug 16 15:25:04 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:25:04 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:25:04 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:25:04 user nova-compute[73091]:       <nova:owner>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:user uuid="e95fc30b3405462fa36a3851ca239445">tempest-ServerStableDeviceRescueTest-1149513869-project-member</nova:user>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:project uuid="864a6fc58ffc491aa91905472cca305b">tempest-ServerStableDeviceRescueTest-1149513869</nova:project>
Aug 16 15:25:04 user nova-compute[73091]:       </nova:owner>
Aug 16 15:25:04 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:25:04 user nova-compute[73091]:       <nova:ports>
Aug 16 15:25:04 user nova-compute[73091]:         <nova:port uuid="02aa6015-41d4-4e38-aa29-9033e35b4a6b">
Aug 16 15:25:04 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 15:25:04 user nova-compute[73091]:         </nova:port>
Aug 16 15:25:04 user nova-compute[73091]:       </nova:ports>
Aug 16 15:25:04 user nova-compute[73091]:     </nova:instance>
Aug 16 15:25:04 user nova-compute[73091]:   </metadata>
Aug 16 15:25:04 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:25:04 user nova-compute[73091]:     <system>
Aug 16 15:25:04 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:25:04 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:25:04 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:25:04 user nova-compute[73091]:       <entry name="serial">e7594dba-8a65-425f-9b10-35b9a0c5e57a</entry>
Aug 16 15:25:04 user nova-compute[73091]:       <entry name="uuid">e7594dba-8a65-425f-9b10-35b9a0c5e57a</entry>
Aug 16 15:25:04 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:25:04 user nova-compute[73091]:     </system>
Aug 16 15:25:04 user nova-compute[73091]:   </sysinfo>
Aug 16 15:25:04 user nova-compute[73091]:   <os>
Aug 16 15:25:04 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:25:04 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:25:04 user nova-compute[73091]:   </os>
Aug 16 15:25:04 user nova-compute[73091]:   <features>
Aug 16 15:25:04 user nova-compute[73091]:     <acpi/>
Aug 16 15:25:04 user nova-compute[73091]:     <apic/>
Aug 16 15:25:04 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:25:04 user nova-compute[73091]:   </features>
Aug 16 15:25:04 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:25:04 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:25:04 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:25:04 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:25:04 user nova-compute[73091]:   </clock>
Aug 16 15:25:04 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:25:04 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:25:04 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:25:04 user nova-compute[73091]:   </cpu>
Aug 16 15:25:04 user nova-compute[73091]:   <devices>
Aug 16 15:25:04 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:25:04 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:25:04 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk"/>
Aug 16 15:25:04 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:25:04 user nova-compute[73091]:     </disk>
Aug 16 15:25:04 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:25:04 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:25:04 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:25:04 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 15:25:04 user nova-compute[73091]:       <serial>9c999f73-53f5-4275-81b1-2d6606f1f81b</serial>
Aug 16 15:25:04 user nova-compute[73091]:     </disk>
Aug 16 15:25:04 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:25:04 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:25:04 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue"/>
Aug 16 15:25:04 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 15:25:04 user nova-compute[73091]:       <boot order="1"/>
Aug 16 15:25:04 user nova-compute[73091]:     </disk>
Aug 16 15:25:04 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:25:04 user nova-compute[73091]:       <mac address="fa:16:3e:94:6d:81"/>
Aug 16 15:25:04 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:25:04 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:25:04 user nova-compute[73091]:       <target dev="tap02aa6015-41"/>
Aug 16 15:25:04 user nova-compute[73091]:     </interface>
Aug 16 15:25:04 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:25:04 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/console.log" append="off"/>
Aug 16 15:25:04 user nova-compute[73091]:     </serial>
Aug 16 15:25:04 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:25:04 user nova-compute[73091]:     <video>
Aug 16 15:25:04 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:25:04 user nova-compute[73091]:     </video>
Aug 16 15:25:04 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:25:04 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:25:04 user nova-compute[73091]:     </rng>
Aug 16 15:25:04 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:25:04 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:25:04 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:25:04 user nova-compute[73091]:     </memballoon>
Aug 16 15:25:04 user nova-compute[73091]:   </devices>
Aug 16 15:25:04 user nova-compute[73091]: </domain>
Aug 16 15:25:04 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:25:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance destroyed successfully.
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:25:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] No VIF found with MAC fa:16:3e:94:6d:81, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-b90a7f76-d16b-435a-9644-64dc64eb29f1 req-0c2fd22c-df97-43d7-a7d7-025ca8006115 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b90a7f76-d16b-435a-9644-64dc64eb29f1 req-0c2fd22c-df97-43d7-a7d7-025ca8006115 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b90a7f76-d16b-435a-9644-64dc64eb29f1 req-0c2fd22c-df97-43d7-a7d7-025ca8006115 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b90a7f76-d16b-435a-9644-64dc64eb29f1 req-0c2fd22c-df97-43d7-a7d7-025ca8006115 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-b90a7f76-d16b-435a-9644-64dc64eb29f1 req-0c2fd22c-df97-43d7-a7d7-025ca8006115 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:25:06 user nova-compute[73091]: WARNING nova.compute.manager [req-b90a7f76-d16b-435a-9644-64dc64eb29f1 req-0c2fd22c-df97-43d7-a7d7-025ca8006115 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state active and task_state rescuing.
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-changed-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Refreshing instance network info cache due to event network-changed-4d42aa1e-aff7-4892-926b-fd8449c721c5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] Acquiring lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] Acquired lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Refreshing network info cache for port 4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updated VIF entry in instance network info cache for port 4d42aa1e-aff7-4892-926b-fd8449c721c5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updating instance_info_cache with network_info: [{"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0651318a-e175-44c1-906e-cbfb8f2655d1 req-5b530104-1ec9-4bd0-9480-6f1885bb2570 service nova] Releasing lock "refresh_cache-b0283440-ab93-45d9-83aa-9ac990702e40" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b0283440-ab93-45d9-83aa-9ac990702e40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:07 user nova-compute[73091]: INFO nova.compute.manager [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Terminating instance
Aug 16 15:25:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Instance destroyed successfully.
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'resources' on Instance uuid b0283440-ab93-45d9-83aa-9ac990702e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1959894712',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1959894712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1959894712',id=41,image_ref='dae2225a-d046-4a65-a9f7-39c2dcff0c70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/YEiEuRF8M0L/snaK/ItNhiG/b5TmbDn8BlRMbWXNf7/R9jIeJAa8wkkZsioAdDY1eCy648FCFdlhnyqlBGNRIgM+g8XFQuTfGgeTkJemwrtDYqJfDCn0HBpUi59Xl5Q==',key_name='tempest-keypair-973459494',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:23:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-g0dkcgjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1172028538',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=b0283440-ab93-45d9-83aa-9ac990702e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "address": "fa:16:3e:e6:94:72", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d42aa1e-af", "ovs_interfaceid": "4d42aa1e-aff7-4892-926b-fd8449c721c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_vif [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d42aa1e-af, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:08 user nova-compute[73091]: INFO os_vif [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:94:72,bridge_name='br-int',has_traffic_filtering=True,id=4d42aa1e-aff7-4892-926b-fd8449c721c5,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d42aa1e-af')
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRaEJMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:25:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db1cd04-68fd-4391-9e9c-51b1f459e835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:25:08 user nova-compute[73091]: WARNING nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state active and task_state rescuing.
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-vif-unplugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] No waiting events found dispatching network-vif-unplugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-vif-unplugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Acquiring lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] Lock "b0283440-ab93-45d9-83aa-9ac990702e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] No waiting events found dispatching network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:25:08 user nova-compute[73091]: WARNING nova.compute.manager [req-1f773af4-f7d2-4cb9-9384-d6c30c1c9b5e req-629750e8-de67-4bf9-b27c-f501b2a47868 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received unexpected event network-vif-plugged-4d42aa1e-aff7-4892-926b-fd8449c721c5 for instance with vm_state active and task_state deleting.
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d863f39-07e4-4f59-9ac4-f1feef6b4574]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:08 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:25:08 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:08 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 (non-flash)
Aug 16 15:25:08 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c549750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59aefae-d86a-4f74-a177-76428981c35e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c978a-43a5-4ad7-8d80-6be4b1663cc2]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e571d3b-fe39-449d-b605-5c50c03eb5ea]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0d9217-7839-4f6a-98e9-5b1d49f2da14]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26463383064363638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d42b7859', '/dev/disk/by-id/scsi-1SCST_BIOd42b7859-dc80d668b3d58fca') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:25:08 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26463383064363638
Aug 16 15:25:08 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d42b7859
Aug 16 15:25:08 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd42b7859-dc80d668b3d58fca
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc0fbdb-7316-499a-b66f-e5a798086123]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[123dba60-2e8d-4c95-8588-7d2d5eef2741]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for e7594dba-8a65-425f-9b10-35b9a0c5e57a due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199508.6916418, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Resumed (Lifecycle Event)
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8a1d16b4-df3d-4ac2-9f30-6f98a1e03b33 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bce6f1-e1a1-4b86-acfd-9db93b80befb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260]
Aug 16 15:25:08 user nova-compute[73091]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500, portal: 172.16.0.220,3260] successful.
Aug 16 15:25:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199508.693291, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Started (Lifecycle Event)
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc942e1-1a86-4227-a21b-655969481500 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ff022b-7ba9-4abf-9913-0857cf9909f9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== disconnect_volume: return (310ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Deleting instance files /opt/stack/data/nova/instances/b0283440-ab93-45d9-83aa-9ac990702e40_del
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Deletion of /opt/stack/data/nova/instances/b0283440-ab93-45d9-83aa-9ac990702e40_del complete
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:25:08 user nova-compute[73091]: INFO nova.compute.manager [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 16 15:25:08 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:25:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:25:10 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:25:10 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Took 1.39 seconds to deallocate network for instance.
Aug 16 15:25:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-861ec243-9202-4e91-985b-fd4fe297eb91 req-c3f94a51-9001-48fe-8d64-27d641639ec9 service nova] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Received event network-vif-deleted-4d42aa1e-aff7-4892-926b-fd8449c721c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:25:10 user nova-compute[73091]: INFO nova.compute.manager [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 15:25:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Deleting volume: efc942e1-1a86-4227-a21b-655969481500 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 15:25:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:11 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:25:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:25:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:11 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Deleted allocations for instance b0283440-ab93-45d9-83aa-9ac990702e40
Aug 16 15:25:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8377a90a-d16a-4a3e-85da-999ee1f47a93 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b0283440-ab93-45d9-83aa-9ac990702e40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.917s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:18 user nova-compute[73091]: INFO nova.compute.manager [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attaching volume 188fc68f-27fa-4cbf-8cab-dcde0050bcb9 to /dev/vdb
Aug 16 15:25:18 user nova-compute[73091]: DEBUG os_brick.utils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be6df43-07f7-42e2-aa2f-ef6ce17e7e08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d8caab-e3de-4a66-9d57-8e3ddc2d3357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[628292ab-d23b-4a00-8f6b-9a63e9760854]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a365840-9a63-4509-b4cf-dd2a70f100be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:25:18 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:25:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02746243-01ef-4bb5-9102-410aa4888588]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG os_brick.utils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating existing volume attachment record: bea706a5-4f74-43ae-8cb2-e9cbd7887676 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199508.4145925, b0283440-ab93-45d9-83aa-9ac990702e40 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:25:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] VM Stopped (Lifecycle Event)
Aug 16 15:25:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:25:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=25.185630798339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4565ee5f-acb8-4723-b39c-6a734a8906c9 None None] [instance: b0283440-ab93-45d9-83aa-9ac990702e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b398d826-b534-4101-9d17-5e5d687afb57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:25:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUCEtPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:25:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:25:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:25:28 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5330f0-20c5-4531-aff5-788ae6606098]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:25:28 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f29371f-d2d6-4a35-a2d6-2831c798fe77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9] added
Aug 16 15:25:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6289a-d7eb-47cc-85cb-f5676d3011ec]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa9ea8-107d-4938-96ff-903e4f3f1eaa]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUCEtPaw {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUCEtPaw" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c8f56-5ae3-4c09-bf3f-6b04cd6edd6a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUCEtPaw'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5410f02-c6c6-4b77-a9fc-a323e54d5d18]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[752dfe85-8c2b-4324-b7eb-2740ba5ea032]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:29 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:29 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcd5823-17c8-4ad3-b21f-592a3a83cf9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260]
Aug 16 15:25:29 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260] successful.
Aug 16 15:25:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0009d977-cfe8-4e61-b2d7-aa77ea52b8da]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a3b860-3766-4010-924c-e0fef033f8ec]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:29 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:29 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 (non-flash)
Aug 16 15:25:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:29 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:29 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 (non-flash)
Aug 16 15:25:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[968203ce-c129-40f8-9645-a33a09034113]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:25:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUCEtPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23465633736373966', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465633736373966', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:25:30 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:25:30 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:25:30 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:25:30 user nova-compute[73091]:   <serial>188fc68f-27fa-4cbf-8cab-dcde0050bcb9</serial>
Aug 16 15:25:30 user nova-compute[73091]: </disk>
Aug 16 15:25:30 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No VIF found with MAC fa:16:3e:04:22:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:25:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5f74ae5-e2ee-4770-b8c5-bab8fe907277 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.814s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:25:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:25:33 user nova-compute[73091]: INFO nova.compute.manager [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Detaching volume 188fc68f-27fa-4cbf-8cab-dcde0050bcb9
Aug 16 15:25:33 user nova-compute[73091]: INFO nova.virt.block_device [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attempting to driver detach volume 188fc68f-27fa-4cbf-8cab-dcde0050bcb9 from mountpoint /dev/vdb
Aug 16 15:25:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Attempting to detach device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:25:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:25:33 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:25:33 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:25:33 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:25:33 user nova-compute[73091]:   <serial>188fc68f-27fa-4cbf-8cab-dcde0050bcb9</serial>
Aug 16 15:25:33 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:25:33 user nova-compute[73091]: </disk>
Aug 16 15:25:33 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:25:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config.
Aug 16 15:25:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:25:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:25:33 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:25:33 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:25:33 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:25:33 user nova-compute[73091]:   <serial>188fc68f-27fa-4cbf-8cab-dcde0050bcb9</serial>
Aug 16 15:25:33 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:25:33 user nova-compute[73091]: </disk>
Aug 16 15:25:33 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:25:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199534.0476124, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:25:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config.
Aug 16 15:25:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUCEtPaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:25:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dcd977-0b45-44c1-9050-9a7f381977fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8eb119-9cd7-4bad-a793-91a1c087f862]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:34 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:34 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 (non-flash)
Aug 16 15:25:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:25:34 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:25:34 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 (non-flash)
Aug 16 15:25:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11542d6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38529ad0-ce07-4461-9312-e2528f541134]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6026698b-1828-4d10-b77d-ad05f9a7dcb6]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8203ece-d3a6-446d-b69d-951a573ad5a9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeeebcc-1346-4343-b211-25d2befd7e65]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a532a74-c2e0-4923-8384-217220075ce7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d857ab0-e496-4d9c-af33-e4d780446121]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260]
Aug 16 15:25:34 user nova-compute[73091]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9, portal: 172.16.0.220,3260] successful.
Aug 16 15:25:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188fc68f-27fa-4cbf-8cab-dcde0050bcb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df2868-ca77-4eec-af74-5cbd611bbf18]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== disconnect_volume: return (271ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:25:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:25:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:25:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8746b23e-d5af-41db-994e-2ae58ade7a5d tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.620s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:25:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:25:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:25:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:25:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b398d826-b534-4101-9d17-5e5d687afb57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:03 user nova-compute[73091]: INFO nova.compute.manager [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Terminating instance
Aug 16 15:26:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-74e534a2-9259-46f2-9acf-fe31493d1dfd req-9eac6242-20a6-41c2-b894-406bc2376339 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-vif-unplugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74e534a2-9259-46f2-9acf-fe31493d1dfd req-9eac6242-20a6-41c2-b894-406bc2376339 service nova] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74e534a2-9259-46f2-9acf-fe31493d1dfd req-9eac6242-20a6-41c2-b894-406bc2376339 service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74e534a2-9259-46f2-9acf-fe31493d1dfd req-9eac6242-20a6-41c2-b894-406bc2376339 service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-74e534a2-9259-46f2-9acf-fe31493d1dfd req-9eac6242-20a6-41c2-b894-406bc2376339 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] No waiting events found dispatching network-vif-unplugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-74e534a2-9259-46f2-9acf-fe31493d1dfd req-9eac6242-20a6-41c2-b894-406bc2376339 service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-vif-unplugged-ec62d487-db27-40ca-a517-0ef6660e8d57 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:26:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Instance destroyed successfully.
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'resources' on Instance uuid b398d826-b534-4101-9d17-5e5d687afb57 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1365817395',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1365817395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1365817395',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTVdxLhhoxo8DeJoSn9qlVEc3kvoqAOYVPm9owbfc4aoYUMgCoS7soksR/XIZJ6sKvcrlJuVX4xyIX3SZEEAozigK7ow9Osa0YJ54RD0KFcojZ8la2f+jK4YfYksZUKg==',key_name='tempest-keypair-2059138311',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-0ot97l77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=b398d826-b534-4101-9d17-5e5d687afb57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "ec62d487-db27-40ca-a517-0ef6660e8d57", "address": "fa:16:3e:c1:05:88", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d487-db", "ovs_interfaceid": "ec62d487-db27-40ca-a517-0ef6660e8d57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_vif [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec62d487-db, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:04 user nova-compute[73091]: INFO os_vif [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:05:88,bridge_name='br-int',has_traffic_filtering=True,id=ec62d487-db27-40ca-a517-0ef6660e8d57,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec62d487-db')
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viImWFeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:26:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a6c291-b913-4e86-a58e-9a12c53434b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1409fcf8-92b9-42c0-9253-6ae37ca61a3f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:26:04 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 (non-flash)
Aug 16 15:26:04 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c55e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4890d7ed-ec0f-4593-a603-1723406abfce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0068e6f-eec3-4156-a013-6d02604a4dee]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9b5fd-eb1f-4559-aa6e-f3976c85b09a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7688b5b4-0e52-4f10-be95-c29b9f02fe30]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6bbbebf-e795353284b74f35', '/dev/disk/by-id/scsi-26537393533353332', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6bbbebf') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65870a74-d4a3-4d3c-aaed-7501c207a137]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95fe958-4757-4486-b7e2-3372e03d5904]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb56dc6-63b2-4153-9fde-6dba042e5e65]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260]
Aug 16 15:26:04 user nova-compute[73091]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372, portal: 172.16.0.220,3260] successful.
Aug 16 15:26:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b90be8-55dc-49fe-a23e-b4e549771372 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce18d1-c0eb-478c-af7c-a97d5cd2fda9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== disconnect_volume: return (276ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:26:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Deleting instance files /opt/stack/data/nova/instances/b398d826-b534-4101-9d17-5e5d687afb57_del
Aug 16 15:26:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Deletion of /opt/stack/data/nova/instances/b398d826-b534-4101-9d17-5e5d687afb57_del complete
Aug 16 15:26:04 user nova-compute[73091]: INFO nova.compute.manager [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 15:26:04 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:26:04 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:26:05 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:26:05 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Took 0.81 seconds to deallocate network for instance.
Aug 16 15:26:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] Acquiring lock "b398d826-b534-4101-9d17-5e5d687afb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] Lock "b398d826-b534-4101-9d17-5e5d687afb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] No waiting events found dispatching network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:05 user nova-compute[73091]: WARNING nova.compute.manager [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received unexpected event network-vif-plugged-ec62d487-db27-40ca-a517-0ef6660e8d57 for instance with vm_state active and task_state deleting.
Aug 16 15:26:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e9f2687-4f0b-4f8f-8f14-2012b39e85b8 req-2a19bbbc-e623-4f41-91dd-4ae31a930c4b service nova] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Received event network-vif-deleted-ec62d487-db27-40ca-a517-0ef6660e8d57 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:06 user nova-compute[73091]: INFO nova.compute.manager [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 15:26:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Deleting volume: b3b90be8-55dc-49fe-a23e-b4e549771372 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 15:26:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:26:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:26:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:06 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Deleted allocations for instance b398d826-b534-4101-9d17-5e5d687afb57
Aug 16 15:26:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9bebb835-b880-476f-a662-bad17512fc59 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "b398d826-b534-4101-9d17-5e5d687afb57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.354s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:26:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:26:19 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199564.045415, b398d826-b534-4101-9d17-5e5d687afb57 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:26:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b398d826-b534-4101-9d17-5e5d687afb57] VM Stopped (Lifecycle Event)
Aug 16 15:26:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d2c408c1-953a-4c2f-8041-afb2d70f019e None None] [instance: b398d826-b534-4101-9d17-5e5d687afb57] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:26:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:26:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.183250427246094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:26:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:26:24 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:26:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:26:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:26:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:26:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:26:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:26:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:27 user nova-compute[73091]: INFO nova.compute.manager [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attaching volume aa2b2300-de29-4952-8ac2-1de01e4a13d8 to /dev/vdb
Aug 16 15:26:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ecb79-00d8-4067-a671-a11a1f2950b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23bc684-ae89-40fa-9221-f14ce49a8c42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a26a7db-2fd7-4903-8f7f-86cfb0689cd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ed0c3-c217-4d51-beb6-9c6da07bf658]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:26:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:26:28 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:26:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08bbbda-436e-41f4-ba12-e1f3a3202163]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating existing volume attachment record: 970d0dad-10da-4256-8efb-3a0d60dcda34 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquired lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'info_cache' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Releasing lock "refresh_cache-725361f9-395a-4a19-9900-bacbb4315b92" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:26:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance destroyed successfully.
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'resources' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG os_vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c46ede2-2e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:26:34 user nova-compute[73091]: INFO os_vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e')
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start _get_guest_xml network_info=[{"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'numa_topology' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:26:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'pci_devices' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:26:34 user nova-compute[73091]:   <uuid>725361f9-395a-4a19-9900-bacbb4315b92</uuid>
Aug 16 15:26:34 user nova-compute[73091]:   <name>instance-00000024</name>
Aug 16 15:26:34 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:26:34 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:26:34 user nova-compute[73091]:   <metadata>
Aug 16 15:26:34 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:26:34 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:26:34 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-595386289</nova:name>
Aug 16 15:26:34 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:26:34</nova:creationTime>
Aug 16 15:26:34 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:26:34 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:26:34 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:26:34 user nova-compute[73091]:       <nova:owner>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:user uuid="4323609874c6400a986d1041316e8e78">tempest-AttachVolumeTestJSON-1875838463-project-member</nova:user>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:project uuid="2d9fa8ad962c43d4997806056d83f4a4">tempest-AttachVolumeTestJSON-1875838463</nova:project>
Aug 16 15:26:34 user nova-compute[73091]:       </nova:owner>
Aug 16 15:26:34 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:26:34 user nova-compute[73091]:       <nova:ports>
Aug 16 15:26:34 user nova-compute[73091]:         <nova:port uuid="4c46ede2-2e38-4999-aa47-2c7f3a36f65f">
Aug 16 15:26:34 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 15:26:34 user nova-compute[73091]:         </nova:port>
Aug 16 15:26:34 user nova-compute[73091]:       </nova:ports>
Aug 16 15:26:34 user nova-compute[73091]:     </nova:instance>
Aug 16 15:26:34 user nova-compute[73091]:   </metadata>
Aug 16 15:26:34 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:26:34 user nova-compute[73091]:     <system>
Aug 16 15:26:34 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:26:34 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:26:34 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:26:34 user nova-compute[73091]:       <entry name="serial">725361f9-395a-4a19-9900-bacbb4315b92</entry>
Aug 16 15:26:34 user nova-compute[73091]:       <entry name="uuid">725361f9-395a-4a19-9900-bacbb4315b92</entry>
Aug 16 15:26:34 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:26:34 user nova-compute[73091]:     </system>
Aug 16 15:26:34 user nova-compute[73091]:   </sysinfo>
Aug 16 15:26:34 user nova-compute[73091]:   <os>
Aug 16 15:26:34 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:26:34 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:26:34 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:26:34 user nova-compute[73091]:   </os>
Aug 16 15:26:34 user nova-compute[73091]:   <features>
Aug 16 15:26:34 user nova-compute[73091]:     <acpi/>
Aug 16 15:26:34 user nova-compute[73091]:     <apic/>
Aug 16 15:26:34 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:26:34 user nova-compute[73091]:   </features>
Aug 16 15:26:34 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:26:34 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:26:34 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:26:34 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:26:34 user nova-compute[73091]:   </clock>
Aug 16 15:26:34 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:26:34 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:26:34 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:26:34 user nova-compute[73091]:   </cpu>
Aug 16 15:26:34 user nova-compute[73091]:   <devices>
Aug 16 15:26:34 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:26:34 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:26:34 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk"/>
Aug 16 15:26:34 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:26:34 user nova-compute[73091]:     </disk>
Aug 16 15:26:34 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:26:34 user nova-compute[73091]:       <mac address="fa:16:3e:bd:6c:10"/>
Aug 16 15:26:34 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:26:34 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:26:34 user nova-compute[73091]:       <target dev="tap4c46ede2-2e"/>
Aug 16 15:26:34 user nova-compute[73091]:     </interface>
Aug 16 15:26:34 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:26:34 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/console.log" append="off"/>
Aug 16 15:26:34 user nova-compute[73091]:     </serial>
Aug 16 15:26:34 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:26:34 user nova-compute[73091]:     <video>
Aug 16 15:26:34 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:26:34 user nova-compute[73091]:     </video>
Aug 16 15:26:34 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:26:34 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:26:34 user nova-compute[73091]:     </rng>
Aug 16 15:26:34 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:26:34 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:26:34 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:26:34 user nova-compute[73091]:     </memballoon>
Aug 16 15:26:34 user nova-compute[73091]:   </devices>
Aug 16 15:26:34 user nova-compute[73091]: </domain>
Aug 16 15:26:34 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:26:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'trusted_certs' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Cannot resize image /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'migration_context' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG os_vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c46ede2-2e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c46ede2-2e, col_values=(('external_ids', {'iface-id': '4c46ede2-2e38-4999-aa47-2c7f3a36f65f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:6c:10', 'vm-uuid': '725361f9-395a-4a19-9900-bacbb4315b92'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:26:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:35 user nova-compute[73091]: INFO os_vif [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e')
Aug 16 15:26:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-52d0d6fa-ae91-47af-82e0-be94de327ca6 req-e4e13a59-df7b-42f3-8356-b330d38d0970 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-52d0d6fa-ae91-47af-82e0-be94de327ca6 req-e4e13a59-df7b-42f3-8356-b330d38d0970 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-52d0d6fa-ae91-47af-82e0-be94de327ca6 req-e4e13a59-df7b-42f3-8356-b330d38d0970 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-52d0d6fa-ae91-47af-82e0-be94de327ca6 req-e4e13a59-df7b-42f3-8356-b330d38d0970 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-52d0d6fa-ae91-47af-82e0-be94de327ca6 req-e4e13a59-df7b-42f3-8356-b330d38d0970 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:37 user nova-compute[73091]: WARNING nova.compute.manager [req-52d0d6fa-ae91-47af-82e0-be94de327ca6 req-e4e13a59-df7b-42f3-8356-b330d38d0970 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state stopped and task_state powering-on.
Aug 16 15:26:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKkvNYdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:26:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:26:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:26:38 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402cec7-a4e7-4024-9b08-b3575b0ed51c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:26:38 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7908588-df6d-4018-b82e-44382f37b0d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8] added
Aug 16 15:26:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[411584d2-9cf0-40cb-a4c5-2201c7f75eb7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c32dab-5a5b-43ff-983e-55926320ea0a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKkvNYdP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKkvNYdP" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea3093d-c8bb-4844-8d0c-482b9cecd867]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKkvNYdP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a15cdfb-1b81-4aa8-8929-3548b9e7c476]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52331c5a-cf04-4eb6-a58f-7d4f625bbdf9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2bdd45-dbec-407f-a1cd-549f027eb8bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260]
Aug 16 15:26:38 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260] successful.
Aug 16 15:26:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a327d5-c80d-4ce5-8707-f692d46ada97]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[534381ce-94f7-4910-a236-7cc942ae3d33]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:38 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 (non-flash)
Aug 16 15:26:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:38 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 (non-flash)
Aug 16 15:26:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b337095e-15de-4f7c-ba47-81beda5ea794]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:26:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199599.0367985, 725361f9-395a-4a19-9900-bacbb4315b92 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:26:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Resumed (Lifecycle Event)
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:26:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance rebooted successfully.
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c809ceb6-18e6-49c9-9557-b20e3051d367 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:26:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199599.037412, 725361f9-395a-4a19-9900-bacbb4315b92 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:26:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Started (Lifecycle Event)
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-84c59ab3-47d9-4cd7-aeba-5d3e8f10a969 req-52e8227c-de80-4bf7-86b8-41600e6ccac9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84c59ab3-47d9-4cd7-aeba-5d3e8f10a969 req-52e8227c-de80-4bf7-86b8-41600e6ccac9 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84c59ab3-47d9-4cd7-aeba-5d3e8f10a969 req-52e8227c-de80-4bf7-86b8-41600e6ccac9 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84c59ab3-47d9-4cd7-aeba-5d3e8f10a969 req-52e8227c-de80-4bf7-86b8-41600e6ccac9 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-84c59ab3-47d9-4cd7-aeba-5d3e8f10a969 req-52e8227c-de80-4bf7-86b8-41600e6ccac9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:39 user nova-compute[73091]: WARNING nova.compute.manager [req-84c59ab3-47d9-4cd7-aeba-5d3e8f10a969 req-52e8227c-de80-4bf7-86b8-41600e6ccac9 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state active and task_state None.
Aug 16 15:26:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKkvNYdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23962653731306433', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962653731306433', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:26:39 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:26:39 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:26:39 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:26:39 user nova-compute[73091]:   <serial>aa2b2300-de29-4952-8ac2-1de01e4a13d8</serial>
Aug 16 15:26:39 user nova-compute[73091]: </disk>
Aug 16 15:26:39 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No VIF found with MAC fa:16:3e:04:22:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:26:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ceb8091-a07b-4534-8c1d-10d7080840b8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.014s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:42 user nova-compute[73091]: INFO nova.compute.manager [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Detaching volume aa2b2300-de29-4952-8ac2-1de01e4a13d8
Aug 16 15:26:42 user nova-compute[73091]: INFO nova.virt.block_device [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attempting to driver detach volume aa2b2300-de29-4952-8ac2-1de01e4a13d8 from mountpoint /dev/vdb
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Attempting to detach device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:26:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:26:42 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:26:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:26:42 user nova-compute[73091]:   <serial>aa2b2300-de29-4952-8ac2-1de01e4a13d8</serial>
Aug 16 15:26:42 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:26:42 user nova-compute[73091]: </disk>
Aug 16 15:26:42 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:26:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config.
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:26:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:26:42 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:26:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:26:42 user nova-compute[73091]:   <serial>aa2b2300-de29-4952-8ac2-1de01e4a13d8</serial>
Aug 16 15:26:42 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:26:42 user nova-compute[73091]: </disk>
Aug 16 15:26:42 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199602.8491359, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:26:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config.
Aug 16 15:26:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKkvNYdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:26:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733baa6-298e-416b-88ef-1877f604c407]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f556151d-bbe2-49a3-b82f-e811676eb80a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:42 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 (non-flash)
Aug 16 15:26:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:26:42 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 (non-flash)
Aug 16 15:26:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115428dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169ede7-02a9-458c-930d-0f83dfdb52b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5181d3b7-4e0a-4347-ac4b-80174cf11c59]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc7fad5-b68c-4907-ad6c-c3f8c92503ab]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:26:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2199532-e034-4ce2-8e3f-ab5068db5231]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73e9f5-8298-49c2-b610-f84fadc4c971]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb55f11a-ce4a-41af-9b39-81acd825115e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260]
Aug 16 15:26:43 user nova-compute[73091]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8, portal: 172.16.0.220,3260] successful.
Aug 16 15:26:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2b2300-de29-4952-8ac2-1de01e4a13d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[479ba352-4d86-42c6-9d1b-691604a78519]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== disconnect_volume: return (328ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d4d9d8a6-4241-4822-99a6-a797403b7f2b tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.664s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:26:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:26:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:26:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:26:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:51 user nova-compute[73091]: INFO nova.compute.manager [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Unrescuing
Aug 16 15:26:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:26:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:26:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'flavor' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2ec606e6-82c9-4257-ad51-df7ed9d47971 req-390217ef-1146-4baf-a721-afc50132fa86 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2ec606e6-82c9-4257-ad51-df7ed9d47971 req-390217ef-1146-4baf-a721-afc50132fa86 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2ec606e6-82c9-4257-ad51-df7ed9d47971 req-390217ef-1146-4baf-a721-afc50132fa86 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2ec606e6-82c9-4257-ad51-df7ed9d47971 req-390217ef-1146-4baf-a721-afc50132fa86 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2ec606e6-82c9-4257-ad51-df7ed9d47971 req-390217ef-1146-4baf-a721-afc50132fa86 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:52 user nova-compute[73091]: WARNING nova.compute.manager [req-2ec606e6-82c9-4257-ad51-df7ed9d47971 req-390217ef-1146-4baf-a721-afc50132fa86 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:26:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance destroyed successfully.
Aug 16 15:26:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing instance network info cache due to event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updated VIF entry in instance network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:26:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f1458242-e7e1-4bb6-9955-585931a26091 req-63616438-7600-4ca7-9be2-5c317b49fb36 service nova] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:54 user nova-compute[73091]: WARNING nova.compute.manager [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:26:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:54 user nova-compute[73091]: WARNING nova.compute.manager [req-eb0b57ae-19d0-410c-a9b5-e313d943d5a9 req-fec9298c-c3db-4866-a95d-a10ae662a93b service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:26:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing instance network info cache due to event network-changed-02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Refreshing network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updated VIF entry in instance network info cache for port 02aa6015-41d4-4e38-aa29-9033e35b4a6b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:26:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d372dbad-b4f8-4dbb-99a9-874532567518 req-a0693480-f9be-4656-86c2-4b17a50ec3f2 service nova] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcfa9f32-b153-410d-b620-f4f83886a727 req-078fa9e4-ddd9-4909-a482-7e6347c7a1d4 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcfa9f32-b153-410d-b620-f4f83886a727 req-078fa9e4-ddd9-4909-a482-7e6347c7a1d4 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcfa9f32-b153-410d-b620-f4f83886a727 req-078fa9e4-ddd9-4909-a482-7e6347c7a1d4 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcfa9f32-b153-410d-b620-f4f83886a727 req-078fa9e4-ddd9-4909-a482-7e6347c7a1d4 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcfa9f32-b153-410d-b620-f4f83886a727 req-078fa9e4-ddd9-4909-a482-7e6347c7a1d4 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:26:56 user nova-compute[73091]: WARNING nova.compute.manager [req-bcfa9f32-b153-410d-b620-f4f83886a727 req-078fa9e4-ddd9-4909-a482-7e6347c7a1d4 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Removed pending event for e7594dba-8a65-425f-9b10-35b9a0c5e57a due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199616.8994403, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:26:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Resumed (Lifecycle Event)
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fd2eeaaf-abb2-43bd-bfb1-80e2ecdcbcd5 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:26:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199616.901451, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:26:56 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Started (Lifecycle Event)
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:26:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:26:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:26:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:27:07 user nova-compute[73091]: INFO nova.compute.claims [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Claim successful on node user
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:27:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:27:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:27:08 user nova-compute[73091]: INFO nova.virt.block_device [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Booting with volume 8ff9f266-ca57-4cf8-aa60-068b607d151d at /dev/vda
Aug 16 15:27:08 user nova-compute[73091]: DEBUG nova.policy [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab71a5471a4bbcb7845d1293849449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f7da218a484e86a7c25626b2e178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a24ec1-ee2f-4214-802f-31639291281a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d186d-cd7f-4de0-81dd-66118d2251e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[313203b8-7a22-4b8f-830b-216c75b0b4f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9bd0e9-d666-401f-879b-135bb9e4bddb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:27:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:27:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c57d7-c43e-4339-a923-677c025d5aaa]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updating existing volume attachment record: 413988cb-4f58-484f-8245-fba46f4a9dfd {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Successfully created port: d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Successfully updated port: d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquired lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-changed-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Refreshing instance network info cache due to event network-changed-d58cd414-f71c-4561-bb24-f4b0ac97ae79. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] Acquiring lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updating instance_info_cache with network_info: [{"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Releasing lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Instance network_info: |[{"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] Acquired lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:27:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Refreshing network info cache for port d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:27:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updated VIF entry in instance network info cache for port d58cd414-f71c-4561-bb24-f4b0ac97ae79. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:27:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updating instance_info_cache with network_info: [{"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:27:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39bb5e61-37dd-4384-aeca-3df4f98dcb75 req-79bf9825-2942-4bac-90f3-085e6dd5388f service nova] Releasing lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:27:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:27:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Creating image(s)
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Ensure instance console log exists: /opt/stack/data/nova/instances/16f77ba6-1f9a-4f81-b41f-a201cdcaee31/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Start _get_guest_xml network_info=[{"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '413988cb-4f58-484f-8245-fba46f4a9dfd', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16f77ba6-1f9a-4f81-b41f-a201cdcaee31', 'attached_at': '', 'detached_at': '', 'volume_id': '8ff9f266-ca57-4cf8-aa60-068b607d151d', 'serial': '8ff9f266-ca57-4cf8-aa60-068b607d151d'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:27:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:27:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:27:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:27:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:27:18 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee54345-9df4-45ae-a5bc-8bece68d3d47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:27:18 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac22c44-106f-4c5a-89bb-4678692b0cc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d] added
Aug 16 15:27:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a775c-10e1-4441-a1d8-44d9c1013c8f]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffd9386-5e9a-41e5-9943-421cf4855e48]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnagpQuq {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnagpQuq" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c322240-5e9b-40ce-aab1-3417cccbbd68]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnagpQuq'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad2bfe-1ade-4d3e-b274-8c0dcfb92f0a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c3113c-b306-4a88-8016-15c8f5876a1b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:27:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:27:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51414e84-9508-4185-aa8e-d968813de332]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]
Aug 16 15:27:18 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.
Aug 16 15:27:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ed787-eebc-470c-bdc1-6d05f11cebb1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d97217-fb15-4216-bdad-cee2582d345c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:27:19 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:27:19 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee367f4-a8f6-443f-afc1-d9ee68c27066]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:27:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26530626566346336', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530626566346336', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:27:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-151899395',display_name='tempest-TestVolumeBootPattern-server-151899395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-151899395',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-hr0u67ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:27:08Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=16f77ba6-1f9a-4f81-b41f-a201cdcaee31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'pci_devices' on Instance uuid 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:27:20 user nova-compute[73091]:   <uuid>16f77ba6-1f9a-4f81-b41f-a201cdcaee31</uuid>
Aug 16 15:27:20 user nova-compute[73091]:   <name>instance-0000002a</name>
Aug 16 15:27:20 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:27:20 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:27:20 user nova-compute[73091]:   <metadata>
Aug 16 15:27:20 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:27:20 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:27:20 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-151899395</nova:name>
Aug 16 15:27:20 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:27:18</nova:creationTime>
Aug 16 15:27:20 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:27:20 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:27:20 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:27:20 user nova-compute[73091]:       <nova:owner>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:user uuid="b8ab71a5471a4bbcb7845d1293849449">tempest-TestVolumeBootPattern-1172028538-project-member</nova:user>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:project uuid="1236f7da218a484e86a7c25626b2e178">tempest-TestVolumeBootPattern-1172028538</nova:project>
Aug 16 15:27:20 user nova-compute[73091]:       </nova:owner>
Aug 16 15:27:20 user nova-compute[73091]:       <nova:ports>
Aug 16 15:27:20 user nova-compute[73091]:         <nova:port uuid="d58cd414-f71c-4561-bb24-f4b0ac97ae79">
Aug 16 15:27:20 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 15:27:20 user nova-compute[73091]:         </nova:port>
Aug 16 15:27:20 user nova-compute[73091]:       </nova:ports>
Aug 16 15:27:20 user nova-compute[73091]:     </nova:instance>
Aug 16 15:27:20 user nova-compute[73091]:   </metadata>
Aug 16 15:27:20 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:27:20 user nova-compute[73091]:     <system>
Aug 16 15:27:20 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:27:20 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:27:20 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:27:20 user nova-compute[73091]:       <entry name="serial">16f77ba6-1f9a-4f81-b41f-a201cdcaee31</entry>
Aug 16 15:27:20 user nova-compute[73091]:       <entry name="uuid">16f77ba6-1f9a-4f81-b41f-a201cdcaee31</entry>
Aug 16 15:27:20 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:27:20 user nova-compute[73091]:     </system>
Aug 16 15:27:20 user nova-compute[73091]:   </sysinfo>
Aug 16 15:27:20 user nova-compute[73091]:   <os>
Aug 16 15:27:20 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:27:20 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:27:20 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:27:20 user nova-compute[73091]:   </os>
Aug 16 15:27:20 user nova-compute[73091]:   <features>
Aug 16 15:27:20 user nova-compute[73091]:     <acpi/>
Aug 16 15:27:20 user nova-compute[73091]:     <apic/>
Aug 16 15:27:20 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:27:20 user nova-compute[73091]:   </features>
Aug 16 15:27:20 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:27:20 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:27:20 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:27:20 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:27:20 user nova-compute[73091]:   </clock>
Aug 16 15:27:20 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:27:20 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:27:20 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:27:20 user nova-compute[73091]:   </cpu>
Aug 16 15:27:20 user nova-compute[73091]:   <devices>
Aug 16 15:27:20 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:27:20 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:27:20 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 15:27:20 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:27:20 user nova-compute[73091]:       <serial>8ff9f266-ca57-4cf8-aa60-068b607d151d</serial>
Aug 16 15:27:20 user nova-compute[73091]:     </disk>
Aug 16 15:27:20 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:27:20 user nova-compute[73091]:       <mac address="fa:16:3e:49:a7:84"/>
Aug 16 15:27:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:27:20 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:27:20 user nova-compute[73091]:       <target dev="tapd58cd414-f7"/>
Aug 16 15:27:20 user nova-compute[73091]:     </interface>
Aug 16 15:27:20 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:27:20 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/16f77ba6-1f9a-4f81-b41f-a201cdcaee31/console.log" append="off"/>
Aug 16 15:27:20 user nova-compute[73091]:     </serial>
Aug 16 15:27:20 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:27:20 user nova-compute[73091]:     <video>
Aug 16 15:27:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:27:20 user nova-compute[73091]:     </video>
Aug 16 15:27:20 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:27:20 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:27:20 user nova-compute[73091]:     </rng>
Aug 16 15:27:20 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:27:20 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:27:20 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:27:20 user nova-compute[73091]:     </memballoon>
Aug 16 15:27:20 user nova-compute[73091]:   </devices>
Aug 16 15:27:20 user nova-compute[73091]: </domain>
Aug 16 15:27:20 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:27:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-151899395',display_name='tempest-TestVolumeBootPattern-server-151899395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-151899395',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-hr0u67ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:27:08Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=16f77ba6-1f9a-4f81-b41f-a201cdcaee31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG os_vif [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd58cd414-f7, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd58cd414-f7, col_values=(('external_ids', {'iface-id': 'd58cd414-f71c-4561-bb24-f4b0ac97ae79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:a7:84', 'vm-uuid': '16f77ba6-1f9a-4f81-b41f-a201cdcaee31'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:20 user nova-compute[73091]: INFO os_vif [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7')
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No VIF found with MAC fa:16:3e:49:a7:84, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:27:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-716908de-722a-4278-9d4f-362a7f55cd0f req-900d6b24-9f3e-4df2-84f8-b90a2eda8092 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-716908de-722a-4278-9d4f-362a7f55cd0f req-900d6b24-9f3e-4df2-84f8-b90a2eda8092 service nova] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-716908de-722a-4278-9d4f-362a7f55cd0f req-900d6b24-9f3e-4df2-84f8-b90a2eda8092 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-716908de-722a-4278-9d4f-362a7f55cd0f req-900d6b24-9f3e-4df2-84f8-b90a2eda8092 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-716908de-722a-4278-9d4f-362a7f55cd0f req-900d6b24-9f3e-4df2-84f8-b90a2eda8092 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] No waiting events found dispatching network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:27:21 user nova-compute[73091]: WARNING nova.compute.manager [req-716908de-722a-4278-9d4f-362a7f55cd0f req-900d6b24-9f3e-4df2-84f8-b90a2eda8092 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received unexpected event network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 for instance with vm_state building and task_state spawning.
Aug 16 15:27:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199643.5608842, 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] VM Resumed (Lifecycle Event)
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Instance spawned successfully.
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199643.5647404, 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] VM Started (Lifecycle Event)
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-e71bf56d-cc1b-4e20-b234-4b3410fbd9b1 req-6ff20f8f-90d7-49cf-9fc5-55c7aa7c3193 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e71bf56d-cc1b-4e20-b234-4b3410fbd9b1 req-6ff20f8f-90d7-49cf-9fc5-55c7aa7c3193 service nova] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e71bf56d-cc1b-4e20-b234-4b3410fbd9b1 req-6ff20f8f-90d7-49cf-9fc5-55c7aa7c3193 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e71bf56d-cc1b-4e20-b234-4b3410fbd9b1 req-6ff20f8f-90d7-49cf-9fc5-55c7aa7c3193 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-e71bf56d-cc1b-4e20-b234-4b3410fbd9b1 req-6ff20f8f-90d7-49cf-9fc5-55c7aa7c3193 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] No waiting events found dispatching network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:27:23 user nova-compute[73091]: WARNING nova.compute.manager [req-e71bf56d-cc1b-4e20-b234-4b3410fbd9b1 req-6ff20f8f-90d7-49cf-9fc5-55c7aa7c3193 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received unexpected event network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 for instance with vm_state building and task_state spawning.
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:23 user nova-compute[73091]: INFO nova.compute.manager [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Took 16.21 seconds to build instance.
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71391cd4-139e-44b7-89ef-76785d74de09 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.300s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:27:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:27:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.180126190185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e7594dba-8a65-425f-9b10-35b9a0c5e57a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:25 user nova-compute[73091]: INFO nova.compute.manager [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Detaching volume 9c999f73-53f5-4275-81b1-2d6606f1f81b
Aug 16 15:27:25 user nova-compute[73091]: INFO nova.virt.block_device [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Attempting to driver detach volume 9c999f73-53f5-4275-81b1-2d6606f1f81b from mountpoint /dev/vdb
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Attempting to detach device vdb from instance e7594dba-8a65-425f-9b10-35b9a0c5e57a from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:27:25 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:27:25 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:27:25 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:27:25 user nova-compute[73091]:   <serial>9c999f73-53f5-4275-81b1-2d6606f1f81b</serial>
Aug 16 15:27:25 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:27:25 user nova-compute[73091]: </disk>
Aug 16 15:27:25 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:27:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Successfully detached device vdb from instance e7594dba-8a65-425f-9b10-35b9a0c5e57a from the persistent domain config.
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7594dba-8a65-425f-9b10-35b9a0c5e57a from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:27:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:27:25 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:27:25 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:27:25 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:27:25 user nova-compute[73091]:   <serial>9c999f73-53f5-4275-81b1-2d6606f1f81b</serial>
Aug 16 15:27:25 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:27:25 user nova-compute[73091]: </disk>
Aug 16 15:27:25 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199646.0665455, e7594dba-8a65-425f-9b10-35b9a0c5e57a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:27:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Successfully detached device vdb from instance e7594dba-8a65-425f-9b10-35b9a0c5e57a from the live domain config.
Aug 16 15:27:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgwbnKoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:27:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef2e98-7a0a-45ae-b3cf-8441b9ed539a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[632ee983-5080-4bc9-98eb-6c886ae15bc8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:27:26 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b (non-flash)
Aug 16 15:27:26 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c2fc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb05b7-91f2-463f-a411-bac17e7d4f18]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e6d3cf-641f-4625-b483-8952b398e43c]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f5f53b-4bbe-48ba-809e-fd4e5390e708]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ab19a-dfd3-4e7c-a8c6-fd26c8731132]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3ca127-9c4d-4aa0-b4f6-8f88ef34fe09]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1734ec-fcab-4936-80cd-d77cafbd734d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260]
Aug 16 15:27:26 user nova-compute[73091]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b, portal: 172.16.0.220,3260] successful.
Aug 16 15:27:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c999f73-53f5-4275-81b1-2d6606f1f81b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dbdab7-9572-4343-9583-879416a53a1a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] <== disconnect_volume: return (300ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:27:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:27:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'flavor' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:27:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6fa58bd-e1c8-49b5-9478-8dfc4e81f6a6 tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.735s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [{"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:27:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-e7594dba-8a65-425f-9b10-35b9a0c5e57a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:27:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:27:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:27:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:27:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:27:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:27:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:27:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:36 user nova-compute[73091]: INFO nova.compute.manager [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attaching volume 8fb45c2b-85b4-4ca7-b00d-16341af93099 to /dev/vdb
Aug 16 15:27:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeebb22-7f8b-4333-99ba-328787dc4ec2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba8f517-b398-470d-a500-8f2c988a1a43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25952f-0460-4c82-8084-b91ae25dce98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5821caa-717d-4788-8c03-1c8454aca896]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:27:36 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:27:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a66714d-2ba2-49df-9ffc-36369670b7d7]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:27:36 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating existing volume attachment record: c4c411f2-ee10-4341-b64c-baf3ef1d5e42 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:27:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVjDzUvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:27:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:27:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:27:47 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae05b0de-ba8b-4c2b-b60f-43f684b91865]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:27:47 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7f847-f976-46a0-8144-4d8490157590]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099] added
Aug 16 15:27:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a7496-451d-4799-bb32-71f09b76e081]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90eb1ce-ec13-4c1c-99a2-48b8d7fb5d9e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVjDzUvL {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVjDzUvL" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f075102c-4ca1-4e74-af3a-0a890be0d0ce]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVjDzUvL'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa9c3d-ace8-4cb1-9999-7346c138c244]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ee353-a7bb-40af-814f-7f7f34071395]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7911648-4c88-4b15-aa9d-7a60e4b44efb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260]
Aug 16 15:27:47 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260] successful.
Aug 16 15:27:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[962b06dd-2482-4573-bf28-440e903f0dd3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccab123-ddbd-4569-a245-3743b6efe066]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:47 user nova-compute[73091]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 (non-flash)
Aug 16 15:27:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:47 user nova-compute[73091]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 (non-flash)
Aug 16 15:27:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fae926-acd5-4f67-8bfa-f2bcfb06a306]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:27:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVjDzUvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26266623334616637', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266623334616637', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:27:48 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:27:48 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:27:48 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:27:48 user nova-compute[73091]:   <serial>8fb45c2b-85b4-4ca7-b00d-16341af93099</serial>
Aug 16 15:27:48 user nova-compute[73091]: </disk>
Aug 16 15:27:48 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:27:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] No VIF found with MAC fa:16:3e:04:22:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:27:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b662a7c8-9b9d-4f0e-953c-aa64cc1953c8 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.537s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:27:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:27:50 user nova-compute[73091]: INFO nova.compute.manager [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Detaching volume 8fb45c2b-85b4-4ca7-b00d-16341af93099
Aug 16 15:27:50 user nova-compute[73091]: INFO nova.virt.block_device [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Attempting to driver detach volume 8fb45c2b-85b4-4ca7-b00d-16341af93099 from mountpoint /dev/vdb
Aug 16 15:27:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Attempting to detach device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:27:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:27:50 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:27:50 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:27:50 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:27:50 user nova-compute[73091]:   <serial>8fb45c2b-85b4-4ca7-b00d-16341af93099</serial>
Aug 16 15:27:50 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:27:50 user nova-compute[73091]: </disk>
Aug 16 15:27:50 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:27:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the persistent domain config.
Aug 16 15:27:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:27:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:27:50 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:27:50 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:27:50 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:27:50 user nova-compute[73091]:   <serial>8fb45c2b-85b4-4ca7-b00d-16341af93099</serial>
Aug 16 15:27:50 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:27:50 user nova-compute[73091]: </disk>
Aug 16 15:27:50 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199671.342797, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:27:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully detached device vdb from instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a from the live domain config.
Aug 16 15:27:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVjDzUvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:27:51 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae7a06-9029-486f-88da-d184dcf91941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6415a164-e1da-4fee-9ad5-e22ed01e6f5d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:51 user nova-compute[73091]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 (non-flash)
Aug 16 15:27:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:27:51 user nova-compute[73091]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 (non-flash)
Aug 16 15:27:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115428f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8c59c-63ba-4ebe-b1b9-9c5912931b1c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe11f6f-7f9f-47ef-a046-7c76f7ca426d]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae54f03-0af1-4f2c-a935-44273e14e748]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c27d72-8865-4d41-b0cc-28d1390a5aec]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5d3f79-ad4b-4e72-ae46-057a8ae06071]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb42ac28-01cb-4d01-b2fe-81b508a72862]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260]
Aug 16 15:27:51 user nova-compute[73091]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099, portal: 172.16.0.220,3260] successful.
Aug 16 15:27:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb45c2b-85b4-4ca7-b00d-16341af93099 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d3b03-7392-4d1e-9ad9-23cacd7a9526]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] <== disconnect_volume: return (280ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:27:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:27:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'flavor' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:27:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5762b40c-2e18-4a62-b07a-1d0c406a42dd tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:27:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:27:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:28:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:28:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:28:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:16 user nova-compute[73091]: INFO nova.compute.manager [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Terminating instance
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-872f02c8-7c17-4503-9d0f-b9c091c0d375 req-78f72974-9b47-4a5a-90ac-568fdbcd6544 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-872f02c8-7c17-4503-9d0f-b9c091c0d375 req-78f72974-9b47-4a5a-90ac-568fdbcd6544 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-872f02c8-7c17-4503-9d0f-b9c091c0d375 req-78f72974-9b47-4a5a-90ac-568fdbcd6544 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-872f02c8-7c17-4503-9d0f-b9c091c0d375 req-78f72974-9b47-4a5a-90ac-568fdbcd6544 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-872f02c8-7c17-4503-9d0f-b9c091c0d375 req-78f72974-9b47-4a5a-90ac-568fdbcd6544 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-872f02c8-7c17-4503-9d0f-b9c091c0d375 req-78f72974-9b47-4a5a-90ac-568fdbcd6544 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-unplugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Instance destroyed successfully.
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lazy-loading 'resources' on Instance uuid e7594dba-8a65-425f-9b10-35b9a0c5e57a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743738867',display_name='tempest-ServerStableDeviceRescueTest-server-1743738867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743738867',id=37,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa8h6cYvARfUqCV5JdjI6N0GPeWXt+eZwXI0stiH6F3WtxolVkANJ+wPxa4xuPVG9+smlfFXwmMkYw7q8Bhq7jnUPNjQRLTfqyIF3ty0Y1pQOE6gS5oF9+ZgUCbEBxODg==',key_name='tempest-keypair-2017314564',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='864a6fc58ffc491aa91905472cca305b',ramdisk_id='',reservation_id='r-wttbpe4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1149513869',owner_user_name='tempest-ServerStableDeviceRescueTest-1149513869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95fc30b3405462fa36a3851ca239445',uuid=e7594dba-8a65-425f-9b10-35b9a0c5e57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converting VIF {"id": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "address": "fa:16:3e:94:6d:81", "network": {"id": "16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2050646901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "864a6fc58ffc491aa91905472cca305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa6015-41", "ovs_interfaceid": "02aa6015-41d4-4e38-aa29-9033e35b4a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG os_vif [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02aa6015-41, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:16 user nova-compute[73091]: INFO os_vif [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:6d:81,bridge_name='br-int',has_traffic_filtering=True,id=02aa6015-41d4-4e38-aa29-9033e35b4a6b,network=Network(16ded2a3-11fb-4951-b99d-a9c7aa3b0c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa6015-41')
Aug 16 15:28:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Deleting instance files /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a_del
Aug 16 15:28:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Deletion of /opt/stack/data/nova/instances/e7594dba-8a65-425f-9b10-35b9a0c5e57a_del complete
Aug 16 15:28:17 user nova-compute[73091]: INFO nova.compute.manager [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 15:28:17 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:28:17 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:28:17 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:28:18 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Took 1.06 seconds to deallocate network for instance.
Aug 16 15:28:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-9e4b1013-9a0f-474a-95d2-d50f35fff4da req-9f944d37-0dd1-417e-9c95-b7b8bc70062c service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-deleted-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:18 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Deleted allocations for instance e7594dba-8a65-425f-9b10-35b9a0c5e57a
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-706d626d-b9b7-4de6-ab09-e26b9f5d421a tempest-ServerStableDeviceRescueTest-1149513869 tempest-ServerStableDeviceRescueTest-1149513869-project-member] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-af54a94e-1fc1-431d-8bdf-02504d1cf920 req-6a5ac7d8-43ba-45c7-a6c8-4e35206230e8 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af54a94e-1fc1-431d-8bdf-02504d1cf920 req-6a5ac7d8-43ba-45c7-a6c8-4e35206230e8 service nova] Acquiring lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af54a94e-1fc1-431d-8bdf-02504d1cf920 req-6a5ac7d8-43ba-45c7-a6c8-4e35206230e8 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af54a94e-1fc1-431d-8bdf-02504d1cf920 req-6a5ac7d8-43ba-45c7-a6c8-4e35206230e8 service nova] Lock "e7594dba-8a65-425f-9b10-35b9a0c5e57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-af54a94e-1fc1-431d-8bdf-02504d1cf920 req-6a5ac7d8-43ba-45c7-a6c8-4e35206230e8 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] No waiting events found dispatching network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:28:18 user nova-compute[73091]: WARNING nova.compute.manager [req-af54a94e-1fc1-431d-8bdf-02504d1cf920 req-6a5ac7d8-43ba-45c7-a6c8-4e35206230e8 service nova] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Received unexpected event network-vif-plugged-02aa6015-41d4-4e38-aa29-9033e35b4a6b for instance with vm_state deleted and task_state None.
Aug 16 15:28:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:25 user nova-compute[73091]: INFO nova.compute.manager [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Terminating instance
Aug 16 15:28:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5582133-1542-4792-8b44-0b0e4f1fe022 req-765cafc5-53c6-449d-ae6b-9b5726d60a35 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5582133-1542-4792-8b44-0b0e4f1fe022 req-765cafc5-53c6-449d-ae6b-9b5726d60a35 service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5582133-1542-4792-8b44-0b0e4f1fe022 req-765cafc5-53c6-449d-ae6b-9b5726d60a35 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5582133-1542-4792-8b44-0b0e4f1fe022 req-765cafc5-53c6-449d-ae6b-9b5726d60a35 service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5582133-1542-4792-8b44-0b0e4f1fe022 req-765cafc5-53c6-449d-ae6b-9b5726d60a35 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:28:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5582133-1542-4792-8b44-0b0e4f1fe022 req-765cafc5-53c6-449d-ae6b-9b5726d60a35 service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-unplugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:28:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Instance destroyed successfully.
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'resources' on Instance uuid 725361f9-395a-4a19-9900-bacbb4315b92 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-595386289',display_name='tempest-AttachVolumeTestJSON-server-595386289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-595386289',id=36,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZLwvVp0kVNA3H6BYrfKgNTz0pZr6KIufJl4X/PbK+x6zqqzCmd6OetHtgEYnqSyfgIsHbhjTDRhqV3s0WNu1SUZrtp46G+SBaA7wRLHIxboZFWZpwQuUphfLodl71BEw==',key_name='tempest-keypair-1070646206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-4w83y8m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=725361f9-395a-4a19-9900-bacbb4315b92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "address": "fa:16:3e:bd:6c:10", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c46ede2-2e", "ovs_interfaceid": "4c46ede2-2e38-4999-aa47-2c7f3a36f65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG os_vif [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c46ede2-2e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:26 user nova-compute[73091]: INFO os_vif [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6c:10,bridge_name='br-int',has_traffic_filtering=True,id=4c46ede2-2e38-4999-aa47-2c7f3a36f65f,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c46ede2-2e')
Aug 16 15:28:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Deleting instance files /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92_del
Aug 16 15:28:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Deletion of /opt/stack/data/nova/instances/725361f9-395a-4a19-9900-bacbb4315b92_del complete
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:28:26 user nova-compute[73091]: INFO nova.compute.manager [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:28:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '725361f9-395a-4a19-9900-bacbb4315b92' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '725361f9-395a-4a19-9900-bacbb4315b92' (instance-00000024)
Aug 16 15:28:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:28:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=25.296104431152344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 725361f9-395a-4a19-9900-bacbb4315b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:28:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-c48579b9-f6df-4a8c-b0ef-c31c3dcb09dd req-a929907b-7e1b-4d20-8fa0-9b1fafa0463c service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c48579b9-f6df-4a8c-b0ef-c31c3dcb09dd req-a929907b-7e1b-4d20-8fa0-9b1fafa0463c service nova] Acquiring lock "725361f9-395a-4a19-9900-bacbb4315b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c48579b9-f6df-4a8c-b0ef-c31c3dcb09dd req-a929907b-7e1b-4d20-8fa0-9b1fafa0463c service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c48579b9-f6df-4a8c-b0ef-c31c3dcb09dd req-a929907b-7e1b-4d20-8fa0-9b1fafa0463c service nova] Lock "725361f9-395a-4a19-9900-bacbb4315b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-c48579b9-f6df-4a8c-b0ef-c31c3dcb09dd req-a929907b-7e1b-4d20-8fa0-9b1fafa0463c service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] No waiting events found dispatching network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:28:27 user nova-compute[73091]: WARNING nova.compute.manager [req-c48579b9-f6df-4a8c-b0ef-c31c3dcb09dd req-a929907b-7e1b-4d20-8fa0-9b1fafa0463c service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received unexpected event network-vif-plugged-4c46ede2-2e38-4999-aa47-2c7f3a36f65f for instance with vm_state active and task_state deleting.
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:28:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Took 1.59 seconds to deallocate network for instance.
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:28:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:27 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Deleted allocations for instance 725361f9-395a-4a19-9900-bacbb4315b92
Aug 16 15:28:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2838a8ab-f304-4780-9463-a60a168a9f31 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "725361f9-395a-4a19-9900-bacbb4315b92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [{"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:28:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:28:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a9e7a39-2407-4287-98ad-325e907371f4 req-f0d5273e-7191-40e7-a281-0649dd916d6c service nova] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Received event network-vif-deleted-4c46ede2-2e38-4999-aa47-2c7f3a36f65f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:28:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:31 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199696.9226642, e7594dba-8a65-425f-9b10-35b9a0c5e57a => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:28:31 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] VM Stopped (Lifecycle Event)
Aug 16 15:28:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0768b2d1-19c9-4a2c-8e6b-24948758133d None None] [instance: e7594dba-8a65-425f-9b10-35b9a0c5e57a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:28:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:28:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199706.0212557, 725361f9-395a-4a19-9900-bacbb4315b92 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:28:41 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] VM Stopped (Lifecycle Event)
Aug 16 15:28:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-156dbbca-d329-4c63-a2ab-46af51983629 None None] [instance: 725361f9-395a-4a19-9900-bacbb4315b92] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:28:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:28:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:28:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-changed-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Refreshing instance network info cache due to event network-changed-d58cd414-f71c-4561-bb24-f4b0ac97ae79. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] Acquiring lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] Acquired lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Refreshing network info cache for port d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updated VIF entry in instance network info cache for port d58cd414-f71c-4561-bb24-f4b0ac97ae79. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updating instance_info_cache with network_info: [{"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9c58179-7ae9-4111-b69c-4c93f17e2367 req-bd4c6c2e-0354-48c7-ae71-de722de5f478 service nova] Releasing lock "refresh_cache-16f77ba6-1f9a-4f81-b41f-a201cdcaee31" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:01 user nova-compute[73091]: INFO nova.compute.manager [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Terminating instance
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f8437e-6efb-4857-bbed-57c828abd085 req-af641e66-11f4-43e6-8df1-a2aadcdccc07 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-vif-unplugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f8437e-6efb-4857-bbed-57c828abd085 req-af641e66-11f4-43e6-8df1-a2aadcdccc07 service nova] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f8437e-6efb-4857-bbed-57c828abd085 req-af641e66-11f4-43e6-8df1-a2aadcdccc07 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f8437e-6efb-4857-bbed-57c828abd085 req-af641e66-11f4-43e6-8df1-a2aadcdccc07 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f8437e-6efb-4857-bbed-57c828abd085 req-af641e66-11f4-43e6-8df1-a2aadcdccc07 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] No waiting events found dispatching network-vif-unplugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f8437e-6efb-4857-bbed-57c828abd085 req-af641e66-11f4-43e6-8df1-a2aadcdccc07 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-vif-unplugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:29:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Instance destroyed successfully.
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'resources' on Instance uuid 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:27:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-151899395',display_name='tempest-TestVolumeBootPattern-server-151899395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-151899395',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-hr0u67ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:27:24Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=16f77ba6-1f9a-4f81-b41f-a201cdcaee31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "address": "fa:16:3e:49:a7:84", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58cd414-f7", "ovs_interfaceid": "d58cd414-f71c-4561-bb24-f4b0ac97ae79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_vif [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd58cd414-f7, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:29:01 user nova-compute[73091]: INFO os_vif [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:a7:84,bridge_name='br-int',has_traffic_filtering=True,id=d58cd414-f71c-4561-bb24-f4b0ac97ae79,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58cd414-f7')
Aug 16 15:29:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:29:01 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf9be1f-14bc-4380-9547-432b43c9f2ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15e902b-1fed-4b52-8902-c6c38b179c3c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:29:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:29:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1154448940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9573d44f-3cab-4179-afc8-cb2c6fbcd383]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e685405-33ea-4e24-abfe-7846340b1bdd]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5037ab6-92af-4269-aa0e-c5a1244c8f46]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:29:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a0c8f-1774-421c-8418-400715073714]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5f0021d4-e0bef4c6fefe02f7', '/dev/disk/by-id/scsi-26530626566346336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f0021d4') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b157c86e-b84b-4aab-98ea-6f75edc51058]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69127bf3-c604-4a8c-a127-cdac1fc0b64c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bfe484-24b4-458e-a825-09b60651e5b6]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]
Aug 16 15:29:02 user nova-compute[73091]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.
Aug 16 15:29:02 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b7204d-6ca2-4198-9372-ac4d59a930ea]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== disconnect_volume: return (284ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:29:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Deleting instance files /opt/stack/data/nova/instances/16f77ba6-1f9a-4f81-b41f-a201cdcaee31_del
Aug 16 15:29:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Deletion of /opt/stack/data/nova/instances/16f77ba6-1f9a-4f81-b41f-a201cdcaee31_del complete
Aug 16 15:29:02 user nova-compute[73091]: INFO nova.compute.manager [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 15:29:02 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:29:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:03 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Took 0.87 seconds to deallocate network for instance.
Aug 16 15:29:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] Acquiring lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] No waiting events found dispatching network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:03 user nova-compute[73091]: WARNING nova.compute.manager [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received unexpected event network-vif-plugged-d58cd414-f71c-4561-bb24-f4b0ac97ae79 for instance with vm_state active and task_state deleting.
Aug 16 15:29:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-36e2cea6-ec87-43b7-a9a0-c20f00e030f6 req-8acbff70-fcf5-4c0c-9bf1-006c1fee4862 service nova] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Received event network-vif-deleted-d58cd414-f71c-4561-bb24-f4b0ac97ae79 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:03 user nova-compute[73091]: INFO nova.compute.manager [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 15:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:29:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:29:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:04 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Deleted allocations for instance 16f77ba6-1f9a-4f81-b41f-a201cdcaee31
Aug 16 15:29:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e047d5fe-2e5b-4809-895c-44cda2206892 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "16f77ba6-1f9a-4f81-b41f-a201cdcaee31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.151s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:29:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199741.7834568, 16f77ba6-1f9a-4f81-b41f-a201cdcaee31 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:29:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] VM Stopped (Lifecycle Event)
Aug 16 15:29:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-311d3cdd-2609-4a59-90df-34bc351be588 None None] [instance: 16f77ba6-1f9a-4f81-b41f-a201cdcaee31] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:29:20 user nova-compute[73091]: INFO nova.compute.claims [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Claim successful on node user
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:29:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:29:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Creating image(s)
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "/opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "/opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "/opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG nova.policy [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4323609874c6400a986d1041316e8e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa8ad962c43d4997806056d83f4a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk 1073741824" returned: 0 in 0.054s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.246s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Cannot resize image /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'migration_context' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Ensure instance console log exists: /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Successfully created port: cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Successfully updated port: cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquired lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-changed-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Refreshing instance network info cache due to event network-changed-cb1b694f-08bc-4dee-b50a-9444589f921c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] Acquiring lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:29:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Releasing lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Instance network_info: |[{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] Acquired lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Refreshing network info cache for port cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Start _get_guest_xml network_info=[{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:29:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:29:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-739938890',display_name='tempest-AttachVolumeTestJSON-server-739938890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-739938890',id=43,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSR2jMNmYBeDaDfP1hXvRTWKz96GketG3OXObwKcc1A4bizKMySyNjASxRKQ40qRuya0VHSCLZOOnQUeLQUSdJUbjn9Uz2uUesDMX2hZldbSIJ70fi5fy5WDi3y9rsd7g==',key_name='tempest-keypair-709513372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-51bww9at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=0711b8f0-7ae2-445e-8063-bac395d25f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'pci_devices' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:29:24 user nova-compute[73091]:   <uuid>0711b8f0-7ae2-445e-8063-bac395d25f36</uuid>
Aug 16 15:29:24 user nova-compute[73091]:   <name>instance-0000002b</name>
Aug 16 15:29:24 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:29:24 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:29:24 user nova-compute[73091]:   <metadata>
Aug 16 15:29:24 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:29:24 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:29:24 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-739938890</nova:name>
Aug 16 15:29:24 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:29:24</nova:creationTime>
Aug 16 15:29:24 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:29:24 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:29:24 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:29:24 user nova-compute[73091]:       <nova:owner>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:user uuid="4323609874c6400a986d1041316e8e78">tempest-AttachVolumeTestJSON-1875838463-project-member</nova:user>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:project uuid="2d9fa8ad962c43d4997806056d83f4a4">tempest-AttachVolumeTestJSON-1875838463</nova:project>
Aug 16 15:29:24 user nova-compute[73091]:       </nova:owner>
Aug 16 15:29:24 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:29:24 user nova-compute[73091]:       <nova:ports>
Aug 16 15:29:24 user nova-compute[73091]:         <nova:port uuid="cb1b694f-08bc-4dee-b50a-9444589f921c">
Aug 16 15:29:24 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 15:29:24 user nova-compute[73091]:         </nova:port>
Aug 16 15:29:24 user nova-compute[73091]:       </nova:ports>
Aug 16 15:29:24 user nova-compute[73091]:     </nova:instance>
Aug 16 15:29:24 user nova-compute[73091]:   </metadata>
Aug 16 15:29:24 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:29:24 user nova-compute[73091]:     <system>
Aug 16 15:29:24 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:29:24 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:29:24 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:29:24 user nova-compute[73091]:       <entry name="serial">0711b8f0-7ae2-445e-8063-bac395d25f36</entry>
Aug 16 15:29:24 user nova-compute[73091]:       <entry name="uuid">0711b8f0-7ae2-445e-8063-bac395d25f36</entry>
Aug 16 15:29:24 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:29:24 user nova-compute[73091]:     </system>
Aug 16 15:29:24 user nova-compute[73091]:   </sysinfo>
Aug 16 15:29:24 user nova-compute[73091]:   <os>
Aug 16 15:29:24 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:29:24 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:29:24 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:29:24 user nova-compute[73091]:   </os>
Aug 16 15:29:24 user nova-compute[73091]:   <features>
Aug 16 15:29:24 user nova-compute[73091]:     <acpi/>
Aug 16 15:29:24 user nova-compute[73091]:     <apic/>
Aug 16 15:29:24 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:29:24 user nova-compute[73091]:   </features>
Aug 16 15:29:24 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:29:24 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:29:24 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:29:24 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:29:24 user nova-compute[73091]:   </clock>
Aug 16 15:29:24 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:29:24 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:29:24 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:29:24 user nova-compute[73091]:   </cpu>
Aug 16 15:29:24 user nova-compute[73091]:   <devices>
Aug 16 15:29:24 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:29:24 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:29:24 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk"/>
Aug 16 15:29:24 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:29:24 user nova-compute[73091]:     </disk>
Aug 16 15:29:24 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:29:24 user nova-compute[73091]:       <mac address="fa:16:3e:b9:07:29"/>
Aug 16 15:29:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:29:24 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:29:24 user nova-compute[73091]:       <target dev="tapcb1b694f-08"/>
Aug 16 15:29:24 user nova-compute[73091]:     </interface>
Aug 16 15:29:24 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:29:24 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/console.log" append="off"/>
Aug 16 15:29:24 user nova-compute[73091]:     </serial>
Aug 16 15:29:24 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:29:24 user nova-compute[73091]:     <video>
Aug 16 15:29:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:29:24 user nova-compute[73091]:     </video>
Aug 16 15:29:24 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:29:24 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:29:24 user nova-compute[73091]:     </rng>
Aug 16 15:29:24 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:29:24 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:29:24 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:29:24 user nova-compute[73091]:     </memballoon>
Aug 16 15:29:24 user nova-compute[73091]:   </devices>
Aug 16 15:29:24 user nova-compute[73091]: </domain>
Aug 16 15:29:24 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-739938890',display_name='tempest-AttachVolumeTestJSON-server-739938890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-739938890',id=43,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSR2jMNmYBeDaDfP1hXvRTWKz96GketG3OXObwKcc1A4bizKMySyNjASxRKQ40qRuya0VHSCLZOOnQUeLQUSdJUbjn9Uz2uUesDMX2hZldbSIJ70fi5fy5WDi3y9rsd7g==',key_name='tempest-keypair-709513372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-51bww9at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=0711b8f0-7ae2-445e-8063-bac395d25f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG os_vif [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb1b694f-08, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb1b694f-08, col_values=(('external_ids', {'iface-id': 'cb1b694f-08bc-4dee-b50a-9444589f921c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:07:29', 'vm-uuid': '0711b8f0-7ae2-445e-8063-bac395d25f36'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:24 user nova-compute[73091]: INFO os_vif [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08')
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:29:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No VIF found with MAC fa:16:3e:b9:07:29, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updated VIF entry in instance network info cache for port cb1b694f-08bc-4dee-b50a-9444589f921c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc14ae91-f74a-44e4-a547-12433fda7314 req-1e8f9eed-4e30-4828-b772-98bddac02ed0 service nova] Releasing lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:25 user nova-compute[73091]: INFO nova.compute.manager [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Terminating instance
Aug 16 15:29:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bc9958e-f529-4690-892f-efa7058000e7 req-4c9fa046-a568-42ee-b995-096eabc86294 service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-vif-unplugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bc9958e-f529-4690-892f-efa7058000e7 req-4c9fa046-a568-42ee-b995-096eabc86294 service nova] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bc9958e-f529-4690-892f-efa7058000e7 req-4c9fa046-a568-42ee-b995-096eabc86294 service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8bc9958e-f529-4690-892f-efa7058000e7 req-4c9fa046-a568-42ee-b995-096eabc86294 service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bc9958e-f529-4690-892f-efa7058000e7 req-4c9fa046-a568-42ee-b995-096eabc86294 service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] No waiting events found dispatching network-vif-unplugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-8bc9958e-f529-4690-892f-efa7058000e7 req-4c9fa046-a568-42ee-b995-096eabc86294 service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-vif-unplugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:29:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Instance destroyed successfully.
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lazy-loading 'resources' on Instance uuid 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-330066798',display_name='tempest-SnapshotDataIntegrityTests-server-330066798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-330066798',id=39,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fVGpVkcmOBrIz8wD9JCMkKW9l/sm1bvrmKy4qU2Be8OZ5fGX3v6MXwOJFAbDpFOntKGgg28bPn9iN2O5v3umVgHmsXHlQGdnj1VhA6k0SAj2IC7rJt2fzlRiGS2w37Q==',key_name='tempest-keypair-899870127',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae64708e843e4a48aad2edc318218b13',ramdisk_id='',reservation_id='r-lvy5lo03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1462586186',owner_user_name='tempest-SnapshotDataIntegrityTests-1462586186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:21:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9f5d292acc34c5f838ba869d2b6a888',uuid=7afa3d53-b3ac-446c-8d4a-b17438c6ec3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Converting VIF {"id": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "address": "fa:16:3e:04:22:72", "network": {"id": "540375c1-9ebd-4aba-8773-9613413b44ef", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941888955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae64708e843e4a48aad2edc318218b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e44f39-a6", "ovs_interfaceid": "52e44f39-a69e-49e9-9e72-013b63cdf1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG os_vif [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e44f39-a6, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:29:26 user nova-compute[73091]: INFO os_vif [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:22:72,bridge_name='br-int',has_traffic_filtering=True,id=52e44f39-a69e-49e9-9e72-013b63cdf1f9,network=Network(540375c1-9ebd-4aba-8773-9613413b44ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e44f39-a6')
Aug 16 15:29:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Deleting instance files /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a_del
Aug 16 15:29:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Deletion of /opt/stack/data/nova/instances/7afa3d53-b3ac-446c-8d4a-b17438c6ec3a_del complete
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:26 user nova-compute[73091]: INFO nova.compute.manager [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199768.1581404, 0711b8f0-7ae2-445e-8063-bac395d25f36 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] VM Resumed (Lifecycle Event)
Aug 16 15:29:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c0d9c36-e439-4f12-8571-2137ef85a877 req-b93228dd-821c-461e-879c-4ff0dce5ad60 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c0d9c36-e439-4f12-8571-2137ef85a877 req-b93228dd-821c-461e-879c-4ff0dce5ad60 service nova] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c0d9c36-e439-4f12-8571-2137ef85a877 req-b93228dd-821c-461e-879c-4ff0dce5ad60 service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c0d9c36-e439-4f12-8571-2137ef85a877 req-b93228dd-821c-461e-879c-4ff0dce5ad60 service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c0d9c36-e439-4f12-8571-2137ef85a877 req-b93228dd-821c-461e-879c-4ff0dce5ad60 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] No waiting events found dispatching network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:28 user nova-compute[73091]: WARNING nova.compute.manager [req-5c0d9c36-e439-4f12-8571-2137ef85a877 req-b93228dd-821c-461e-879c-4ff0dce5ad60 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received unexpected event network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c for instance with vm_state building and task_state spawning.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca527587-b002-487e-9d97-656385bbfa0a req-bcb8e06c-2bdc-4454-a177-2a74ad5a271b service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-vif-deleted-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [req-ca527587-b002-487e-9d97-656385bbfa0a req-bcb8e06c-2bdc-4454-a177-2a74ad5a271b service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Neutron deleted interface 52e44f39-a69e-49e9-9e72-013b63cdf1f9; detaching it from the instance and deleting it from the info cache
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-ca527587-b002-487e-9d97-656385bbfa0a req-bcb8e06c-2bdc-4454-a177-2a74ad5a271b service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e3b324e-a963-4e7d-9bda-e32c23e6f88b req-04f67dfc-9f53-4b89-90cd-65ef36527bac service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received event network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e3b324e-a963-4e7d-9bda-e32c23e6f88b req-04f67dfc-9f53-4b89-90cd-65ef36527bac service nova] Acquiring lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e3b324e-a963-4e7d-9bda-e32c23e6f88b req-04f67dfc-9f53-4b89-90cd-65ef36527bac service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8e3b324e-a963-4e7d-9bda-e32c23e6f88b req-04f67dfc-9f53-4b89-90cd-65ef36527bac service nova] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-8e3b324e-a963-4e7d-9bda-e32c23e6f88b req-04f67dfc-9f53-4b89-90cd-65ef36527bac service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] No waiting events found dispatching network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:28 user nova-compute[73091]: WARNING nova.compute.manager [req-8e3b324e-a963-4e7d-9bda-e32c23e6f88b req-04f67dfc-9f53-4b89-90cd-65ef36527bac service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Received unexpected event network-vif-plugged-52e44f39-a69e-49e9-9e72-013b63cdf1f9 for instance with vm_state active and task_state deleting.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Instance spawned successfully.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:29:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:29:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=25.349430084228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Took 2.15 seconds to deallocate network for instance.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-ca527587-b002-487e-9d97-656385bbfa0a req-bcb8e06c-2bdc-4454-a177-2a74ad5a271b service nova] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Detach interface failed, port_id=52e44f39-a69e-49e9-9e72-013b63cdf1f9, reason: Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199768.1600266, 0711b8f0-7ae2-445e-8063-bac395d25f36 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] VM Started (Lifecycle Event)
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 0711b8f0-7ae2-445e-8063-bac395d25f36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:29:28 user nova-compute[73091]: INFO nova.compute.manager [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Took 8.82 seconds to build instance.
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.216s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c16e91c3-a624-4f13-b06e-f466a718f363 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.927s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:29:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:29 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Deleted allocations for instance 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b8942d5-7b77-4a64-a57d-490b8518f824 tempest-SnapshotDataIntegrityTests-1462586186 tempest-SnapshotDataIntegrityTests-1462586186-project-member] Lock "7afa3d53-b3ac-446c-8d4a-b17438c6ec3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.839s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-f82a97af-6ce3-4e69-b021-f0047403484c req-b5f6a568-0e60-44d1-ac76-9d0e2dd48b9b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f82a97af-6ce3-4e69-b021-f0047403484c req-b5f6a568-0e60-44d1-ac76-9d0e2dd48b9b service nova] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f82a97af-6ce3-4e69-b021-f0047403484c req-b5f6a568-0e60-44d1-ac76-9d0e2dd48b9b service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f82a97af-6ce3-4e69-b021-f0047403484c req-b5f6a568-0e60-44d1-ac76-9d0e2dd48b9b service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-f82a97af-6ce3-4e69-b021-f0047403484c req-b5f6a568-0e60-44d1-ac76-9d0e2dd48b9b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] No waiting events found dispatching network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:29 user nova-compute[73091]: WARNING nova.compute.manager [req-f82a97af-6ce3-4e69-b021-f0047403484c req-b5f6a568-0e60-44d1-ac76-9d0e2dd48b9b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received unexpected event network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c for instance with vm_state active and task_state None.
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:29:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:29:30 user nova-compute[73091]: INFO nova.compute.claims [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Claim successful on node user
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:29:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.policy [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '043ba186a9b4416c903393c25a4a87d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62db39d6754641d89841f031b210383b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:29:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Creating image(s)
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "/opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk 1073741824" returned: 0 in 0.058s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Successfully created port: 4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Cannot resize image /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'migration_context' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Ensure instance console log exists: /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Successfully updated port: 4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquired lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-changed-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Refreshing instance network info cache due to event network-changed-4474ae2a-6c21-4bba-9d69-4f8d18ace014. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] Acquiring lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating instance_info_cache with network_info: [{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Releasing lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Instance network_info: |[{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] Acquired lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Refreshing network info cache for port 4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Start _get_guest_xml network_info=[{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:29:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:29:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-667200703',display_name='tempest-AttachVolumeNegativeTest-server-667200703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-667200703',id=44,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbKE1B3BH6N9QGtYienQGSiXOsYThgs6EUgxu+wQaBRgFu8edWrJzzhqZjRNI9L4W0baa+Bm+40UMRFPta0nYBGmLa8pXPlTl1ItXjAJybeQejN1OMlVvHVjg8Ve8RiNA==',key_name='tempest-keypair-1714077594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-n7lrksyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=154458da-2fd8-424f-9a2c-e253bc342379,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'pci_devices' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:29:33 user nova-compute[73091]:   <uuid>154458da-2fd8-424f-9a2c-e253bc342379</uuid>
Aug 16 15:29:33 user nova-compute[73091]:   <name>instance-0000002c</name>
Aug 16 15:29:33 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:29:33 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:29:33 user nova-compute[73091]:   <metadata>
Aug 16 15:29:33 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:29:33 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:29:33 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-667200703</nova:name>
Aug 16 15:29:33 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:29:33</nova:creationTime>
Aug 16 15:29:33 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:29:33 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:29:33 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:29:33 user nova-compute[73091]:       <nova:owner>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:user uuid="043ba186a9b4416c903393c25a4a87d6">tempest-AttachVolumeNegativeTest-2024154116-project-member</nova:user>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:project uuid="62db39d6754641d89841f031b210383b">tempest-AttachVolumeNegativeTest-2024154116</nova:project>
Aug 16 15:29:33 user nova-compute[73091]:       </nova:owner>
Aug 16 15:29:33 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:29:33 user nova-compute[73091]:       <nova:ports>
Aug 16 15:29:33 user nova-compute[73091]:         <nova:port uuid="4474ae2a-6c21-4bba-9d69-4f8d18ace014">
Aug 16 15:29:33 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:29:33 user nova-compute[73091]:         </nova:port>
Aug 16 15:29:33 user nova-compute[73091]:       </nova:ports>
Aug 16 15:29:33 user nova-compute[73091]:     </nova:instance>
Aug 16 15:29:33 user nova-compute[73091]:   </metadata>
Aug 16 15:29:33 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:29:33 user nova-compute[73091]:     <system>
Aug 16 15:29:33 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:29:33 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:29:33 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:29:33 user nova-compute[73091]:       <entry name="serial">154458da-2fd8-424f-9a2c-e253bc342379</entry>
Aug 16 15:29:33 user nova-compute[73091]:       <entry name="uuid">154458da-2fd8-424f-9a2c-e253bc342379</entry>
Aug 16 15:29:33 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:29:33 user nova-compute[73091]:     </system>
Aug 16 15:29:33 user nova-compute[73091]:   </sysinfo>
Aug 16 15:29:33 user nova-compute[73091]:   <os>
Aug 16 15:29:33 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:29:33 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:29:33 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:29:33 user nova-compute[73091]:   </os>
Aug 16 15:29:33 user nova-compute[73091]:   <features>
Aug 16 15:29:33 user nova-compute[73091]:     <acpi/>
Aug 16 15:29:33 user nova-compute[73091]:     <apic/>
Aug 16 15:29:33 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:29:33 user nova-compute[73091]:   </features>
Aug 16 15:29:33 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:29:33 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:29:33 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:29:33 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:29:33 user nova-compute[73091]:   </clock>
Aug 16 15:29:33 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:29:33 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:29:33 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:29:33 user nova-compute[73091]:   </cpu>
Aug 16 15:29:33 user nova-compute[73091]:   <devices>
Aug 16 15:29:33 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:29:33 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:29:33 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk"/>
Aug 16 15:29:33 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:29:33 user nova-compute[73091]:     </disk>
Aug 16 15:29:33 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:29:33 user nova-compute[73091]:       <mac address="fa:16:3e:52:9d:62"/>
Aug 16 15:29:33 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:29:33 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:29:33 user nova-compute[73091]:       <target dev="tap4474ae2a-6c"/>
Aug 16 15:29:33 user nova-compute[73091]:     </interface>
Aug 16 15:29:33 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:29:33 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/console.log" append="off"/>
Aug 16 15:29:33 user nova-compute[73091]:     </serial>
Aug 16 15:29:33 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:29:33 user nova-compute[73091]:     <video>
Aug 16 15:29:33 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:29:33 user nova-compute[73091]:     </video>
Aug 16 15:29:33 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:29:33 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:29:33 user nova-compute[73091]:     </rng>
Aug 16 15:29:33 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:29:33 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:29:33 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:29:33 user nova-compute[73091]:     </memballoon>
Aug 16 15:29:33 user nova-compute[73091]:   </devices>
Aug 16 15:29:33 user nova-compute[73091]: </domain>
Aug 16 15:29:33 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-667200703',display_name='tempest-AttachVolumeNegativeTest-server-667200703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-667200703',id=44,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbKE1B3BH6N9QGtYienQGSiXOsYThgs6EUgxu+wQaBRgFu8edWrJzzhqZjRNI9L4W0baa+Bm+40UMRFPta0nYBGmLa8pXPlTl1ItXjAJybeQejN1OMlVvHVjg8Ve8RiNA==',key_name='tempest-keypair-1714077594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-n7lrksyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=154458da-2fd8-424f-9a2c-e253bc342379,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG os_vif [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4474ae2a-6c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4474ae2a-6c, col_values=(('external_ids', {'iface-id': '4474ae2a-6c21-4bba-9d69-4f8d18ace014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:9d:62', 'vm-uuid': '154458da-2fd8-424f-9a2c-e253bc342379'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:33 user nova-compute[73091]: INFO os_vif [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c')
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:29:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:52:9d:62, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updated VIF entry in instance network info cache for port 4474ae2a-6c21-4bba-9d69-4f8d18ace014. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating instance_info_cache with network_info: [{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-32d1f8e5-7a0e-46c5-9b79-89916259f597 req-2d26f872-03b4-45f5-8616-430173e5efb0 service nova] Releasing lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-169d1ffe-4f92-4217-8040-f39617bcf859 req-e3c87fb6-e3c5-4046-9cd0-a17b9aa7b3d7 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-169d1ffe-4f92-4217-8040-f39617bcf859 req-e3c87fb6-e3c5-4046-9cd0-a17b9aa7b3d7 service nova] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-169d1ffe-4f92-4217-8040-f39617bcf859 req-e3c87fb6-e3c5-4046-9cd0-a17b9aa7b3d7 service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-169d1ffe-4f92-4217-8040-f39617bcf859 req-e3c87fb6-e3c5-4046-9cd0-a17b9aa7b3d7 service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-169d1ffe-4f92-4217-8040-f39617bcf859 req-e3c87fb6-e3c5-4046-9cd0-a17b9aa7b3d7 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] No waiting events found dispatching network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:34 user nova-compute[73091]: WARNING nova.compute.manager [req-169d1ffe-4f92-4217-8040-f39617bcf859 req-e3c87fb6-e3c5-4046-9cd0-a17b9aa7b3d7 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received unexpected event network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 for instance with vm_state building and task_state spawning.
Aug 16 15:29:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199776.909093, 154458da-2fd8-424f-9a2c-e253bc342379 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:29:36 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] VM Resumed (Lifecycle Event)
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:29:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Instance spawned successfully.
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:29:36 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199776.9107478, 154458da-2fd8-424f-9a2c-e253bc342379 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:29:36 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] VM Started (Lifecycle Event)
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:29:37 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:29:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5197ec6-7ee7-47bf-9db0-adb4410e950d req-cc96529a-0087-4fd3-86df-670063de6b10 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5197ec6-7ee7-47bf-9db0-adb4410e950d req-cc96529a-0087-4fd3-86df-670063de6b10 service nova] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5197ec6-7ee7-47bf-9db0-adb4410e950d req-cc96529a-0087-4fd3-86df-670063de6b10 service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5197ec6-7ee7-47bf-9db0-adb4410e950d req-cc96529a-0087-4fd3-86df-670063de6b10 service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5197ec6-7ee7-47bf-9db0-adb4410e950d req-cc96529a-0087-4fd3-86df-670063de6b10 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] No waiting events found dispatching network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:29:37 user nova-compute[73091]: WARNING nova.compute.manager [req-c5197ec6-7ee7-47bf-9db0-adb4410e950d req-cc96529a-0087-4fd3-86df-670063de6b10 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received unexpected event network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 for instance with vm_state building and task_state spawning.
Aug 16 15:29:37 user nova-compute[73091]: INFO nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 16 15:29:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:37 user nova-compute[73091]: INFO nova.compute.manager [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Took 6.33 seconds to build instance.
Aug 16 15:29:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-946c8c73-e269-4e97-830e-93a82d03522f tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.441s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:29:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:29:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:41 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199766.263739, 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:29:41 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] VM Stopped (Lifecycle Event)
Aug 16 15:29:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dc54428c-8492-4df0-b3e5-648c24ee90e2 None None] [instance: 7afa3d53-b3ac-446c-8d4a-b17438c6ec3a] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:29:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:29:53 user nova-compute[73091]: INFO nova.compute.claims [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Claim successful on node user
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:29:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:29:53 user nova-compute[73091]: INFO nova.virt.block_device [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Booting with volume 8ff9f266-ca57-4cf8-aa60-068b607d151d at /dev/vda
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.policy [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab71a5471a4bbcb7845d1293849449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f7da218a484e86a7c25626b2e178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG os_brick.utils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b660b1d-1b73-4e05-b187-a80d8eb5740d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b736cb82-ba7a-483e-be4d-aecf7836cdc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fef748f-bd6f-43dc-9f9c-203d47035b58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b3b12-388b-4d99-a662-0c8c095843f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:29:53 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:29:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb4b976-22c0-4f4e-8651-c9880fd4e30a]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG os_brick.utils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:29:53 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating existing volume attachment record: 86805c44-119b-4b65-98ef-4fb4018f899c {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:29:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Successfully created port: 8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Successfully updated port: 8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquired lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-changed-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Refreshing instance network info cache due to event network-changed-8e23be71-643c-4893-ad6f-188af8faa2eb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] Acquiring lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Releasing lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Instance network_info: |[{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] Acquired lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Refreshing network info cache for port 8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updated VIF entry in instance network info cache for port 8e23be71-643c-4893-ad6f-188af8faa2eb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24a865b7-647b-4c9a-86f2-868ab6a6d6e0 req-caf90037-0068-48d5-b22f-64446aaecf19 service nova] Releasing lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:29:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:29:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:30:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Creating image(s)
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Ensure instance console log exists: /opt/stack/data/nova/instances/bccac10d-9eaa-4371-9db9-5da725b0f5b4/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Start _get_guest_xml network_info=[{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '86805c44-119b-4b65-98ef-4fb4018f899c', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bccac10d-9eaa-4371-9db9-5da725b0f5b4', 'attached_at': '', 'detached_at': '', 'volume_id': '8ff9f266-ca57-4cf8-aa60-068b607d151d', 'serial': '8ff9f266-ca57-4cf8-aa60-068b607d151d'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:30:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:30:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:30:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:30:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:30:03 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3b015-1cc1-47c8-a084-607e798f4965]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:30:03 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[390c21bc-80de-46e0-b39d-007fc74aec56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d] added
Aug 16 15:30:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e8924c-dd2c-42c2-8488-992fd336fd50]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe1e823-270b-4bf1-ba2c-dd31b6d09bf9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnagpQuq {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnagpQuq" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5aaa3d-7a2b-41a0-a4ea-b701171b4965]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnagpQuq'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d461d818-dfc6-482f-a6c4-d51f216ffccc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5904caf3-2a21-4bce-9ac3-1092a368d08c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:30:03 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:30:03 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:30:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:30:03 user nova-compute[73091]: 
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7bd33b-d6e3-46d6-9bfe-a7a7d9453e21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]
Aug 16 15:30:03 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.
Aug 16 15:30:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce6e9b-297b-416f-9560-b15695c77f5b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fac8b0c-03b9-4c5a-8a16-cc0b9f9d4944]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:30:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:30:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7811aa-4466-4ae6-9177-285aa6b3d741]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:30:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26530626566346336', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530626566346336', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1914354331',display_name='tempest-TestVolumeBootPattern-server-1914354331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1914354331',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-rysobh5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:29:54Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=bccac10d-9eaa-4371-9db9-5da725b0f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'pci_devices' on Instance uuid bccac10d-9eaa-4371-9db9-5da725b0f5b4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:30:04 user nova-compute[73091]:   <uuid>bccac10d-9eaa-4371-9db9-5da725b0f5b4</uuid>
Aug 16 15:30:04 user nova-compute[73091]:   <name>instance-0000002d</name>
Aug 16 15:30:04 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:30:04 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:30:04 user nova-compute[73091]:   <metadata>
Aug 16 15:30:04 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:30:04 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:30:04 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-1914354331</nova:name>
Aug 16 15:30:04 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:30:03</nova:creationTime>
Aug 16 15:30:04 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:30:04 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:30:04 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:30:04 user nova-compute[73091]:       <nova:owner>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:user uuid="b8ab71a5471a4bbcb7845d1293849449">tempest-TestVolumeBootPattern-1172028538-project-member</nova:user>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:project uuid="1236f7da218a484e86a7c25626b2e178">tempest-TestVolumeBootPattern-1172028538</nova:project>
Aug 16 15:30:04 user nova-compute[73091]:       </nova:owner>
Aug 16 15:30:04 user nova-compute[73091]:       <nova:ports>
Aug 16 15:30:04 user nova-compute[73091]:         <nova:port uuid="8e23be71-643c-4893-ad6f-188af8faa2eb">
Aug 16 15:30:04 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:30:04 user nova-compute[73091]:         </nova:port>
Aug 16 15:30:04 user nova-compute[73091]:       </nova:ports>
Aug 16 15:30:04 user nova-compute[73091]:     </nova:instance>
Aug 16 15:30:04 user nova-compute[73091]:   </metadata>
Aug 16 15:30:04 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:30:04 user nova-compute[73091]:     <system>
Aug 16 15:30:04 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:30:04 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:30:04 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:30:04 user nova-compute[73091]:       <entry name="serial">bccac10d-9eaa-4371-9db9-5da725b0f5b4</entry>
Aug 16 15:30:04 user nova-compute[73091]:       <entry name="uuid">bccac10d-9eaa-4371-9db9-5da725b0f5b4</entry>
Aug 16 15:30:04 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:30:04 user nova-compute[73091]:     </system>
Aug 16 15:30:04 user nova-compute[73091]:   </sysinfo>
Aug 16 15:30:04 user nova-compute[73091]:   <os>
Aug 16 15:30:04 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:30:04 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:30:04 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:30:04 user nova-compute[73091]:   </os>
Aug 16 15:30:04 user nova-compute[73091]:   <features>
Aug 16 15:30:04 user nova-compute[73091]:     <acpi/>
Aug 16 15:30:04 user nova-compute[73091]:     <apic/>
Aug 16 15:30:04 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:30:04 user nova-compute[73091]:   </features>
Aug 16 15:30:04 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:30:04 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:30:04 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:30:04 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:30:04 user nova-compute[73091]:   </clock>
Aug 16 15:30:04 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:30:04 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:30:04 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:30:04 user nova-compute[73091]:   </cpu>
Aug 16 15:30:04 user nova-compute[73091]:   <devices>
Aug 16 15:30:04 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:30:04 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:30:04 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:30:04 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:30:04 user nova-compute[73091]:       <serial>8ff9f266-ca57-4cf8-aa60-068b607d151d</serial>
Aug 16 15:30:04 user nova-compute[73091]:     </disk>
Aug 16 15:30:04 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:30:04 user nova-compute[73091]:       <mac address="fa:16:3e:d3:7a:4f"/>
Aug 16 15:30:04 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:30:04 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:30:04 user nova-compute[73091]:       <target dev="tap8e23be71-64"/>
Aug 16 15:30:04 user nova-compute[73091]:     </interface>
Aug 16 15:30:04 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:30:04 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bccac10d-9eaa-4371-9db9-5da725b0f5b4/console.log" append="off"/>
Aug 16 15:30:04 user nova-compute[73091]:     </serial>
Aug 16 15:30:04 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:30:04 user nova-compute[73091]:     <video>
Aug 16 15:30:04 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:30:04 user nova-compute[73091]:     </video>
Aug 16 15:30:04 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:30:04 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:30:04 user nova-compute[73091]:     </rng>
Aug 16 15:30:04 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:30:04 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:30:04 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:30:04 user nova-compute[73091]:     </memballoon>
Aug 16 15:30:04 user nova-compute[73091]:   </devices>
Aug 16 15:30:04 user nova-compute[73091]: </domain>
Aug 16 15:30:04 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1914354331',display_name='tempest-TestVolumeBootPattern-server-1914354331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1914354331',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-rysobh5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:29:54Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=bccac10d-9eaa-4371-9db9-5da725b0f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG os_vif [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e23be71-64, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e23be71-64, col_values=(('external_ids', {'iface-id': '8e23be71-643c-4893-ad6f-188af8faa2eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:7a:4f', 'vm-uuid': 'bccac10d-9eaa-4371-9db9-5da725b0f5b4'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:30:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:04 user nova-compute[73091]: INFO os_vif [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64')
Aug 16 15:30:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:30:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No VIF found with MAC fa:16:3e:d3:7a:4f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6640776-8aa5-487a-9e8c-8774560e7ca1 req-a1bded79-f29c-4c04-a48c-1ec85ebfc4c8 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6640776-8aa5-487a-9e8c-8774560e7ca1 req-a1bded79-f29c-4c04-a48c-1ec85ebfc4c8 service nova] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6640776-8aa5-487a-9e8c-8774560e7ca1 req-a1bded79-f29c-4c04-a48c-1ec85ebfc4c8 service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6640776-8aa5-487a-9e8c-8774560e7ca1 req-a1bded79-f29c-4c04-a48c-1ec85ebfc4c8 service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6640776-8aa5-487a-9e8c-8774560e7ca1 req-a1bded79-f29c-4c04-a48c-1ec85ebfc4c8 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] No waiting events found dispatching network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:30:06 user nova-compute[73091]: WARNING nova.compute.manager [req-f6640776-8aa5-487a-9e8c-8774560e7ca1 req-a1bded79-f29c-4c04-a48c-1ec85ebfc4c8 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received unexpected event network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb for instance with vm_state building and task_state spawning.
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199808.4786086, bccac10d-9eaa-4371-9db9-5da725b0f5b4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] VM Resumed (Lifecycle Event)
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Instance spawned successfully.
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199808.4796188, bccac10d-9eaa-4371-9db9-5da725b0f5b4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] VM Started (Lifecycle Event)
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-611f576b-d1ed-4ba1-ab86-fbfaf47c96fe req-bc592080-31b6-421b-9a58-831c4e8cdaf7 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-611f576b-d1ed-4ba1-ab86-fbfaf47c96fe req-bc592080-31b6-421b-9a58-831c4e8cdaf7 service nova] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-611f576b-d1ed-4ba1-ab86-fbfaf47c96fe req-bc592080-31b6-421b-9a58-831c4e8cdaf7 service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-611f576b-d1ed-4ba1-ab86-fbfaf47c96fe req-bc592080-31b6-421b-9a58-831c4e8cdaf7 service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-611f576b-d1ed-4ba1-ab86-fbfaf47c96fe req-bc592080-31b6-421b-9a58-831c4e8cdaf7 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] No waiting events found dispatching network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:30:08 user nova-compute[73091]: WARNING nova.compute.manager [req-611f576b-d1ed-4ba1-ab86-fbfaf47c96fe req-bc592080-31b6-421b-9a58-831c4e8cdaf7 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received unexpected event network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb for instance with vm_state building and task_state spawning.
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 16 15:30:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:30:08 user nova-compute[73091]: INFO nova.compute.manager [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Took 15.51 seconds to build instance.
Aug 16 15:30:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-53efbc06-a7e9-4374-a170-cf2cc2006828 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.608s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:30:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:30:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:30:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8402MB free_disk=25.28948974609375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 0711b8f0-7ae2-445e-8063-bac395d25f36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 154458da-2fd8-424f-9a2c-e253bc342379 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance bccac10d-9eaa-4371-9db9-5da725b0f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:30:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:30:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:30:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:30:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:30:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:30:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:30:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:30:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:30:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:30:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:30:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:31:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:31:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:31:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:31:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-changed-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Refreshing instance network info cache due to event network-changed-cb1b694f-08bc-4dee-b50a-9444589f921c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:31:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] Acquiring lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:31:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] Acquired lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:31:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Refreshing network info cache for port cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:31:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updated VIF entry in instance network info cache for port cb1b694f-08bc-4dee-b50a-9444589f921c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:31:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [{"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:31:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1539a99f-1fb9-48aa-b34f-6717ce106ccd req-1e266844-4003-4edf-8407-9d621ee16a40 service nova] Releasing lock "refresh_cache-0711b8f0-7ae2-445e-8063-bac395d25f36" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:31:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attaching volume 27011614-550a-41a6-bf13-fede25ab4578 to /dev/vdb
Aug 16 15:31:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b88cf9-7c68-4512-b275-01166f7143fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c97a21f-5d2b-4303-9e67-206512382e96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6f005d-626a-45c6-9a3e-840da4a0d159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b375a8-90a2-4a14-9ba3-24e29d9df6b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:31:15 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:31:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9aa85b-073b-4f09-a0aa-d1ed28d4735e]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:15 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating existing volume attachment record: 1d4249cf-112f-4ffa-877a-589502c2a006 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:31:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-changed-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Refreshing instance network info cache due to event network-changed-4474ae2a-6c21-4bba-9d69-4f8d18ace014. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] Acquiring lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] Acquired lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:31:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Refreshing network info cache for port 4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:31:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updated VIF entry in instance network info cache for port 4474ae2a-6c21-4bba-9d69-4f8d18ace014. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:31:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating instance_info_cache with network_info: [{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:31:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f40219f4-5b3a-4bca-a335-b5be7af0a3b9 req-a03194c4-6d6d-4ffd-b58e-96b53166dc1a service nova] Releasing lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:31:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:31:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:31:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:25 user nova-compute[73091]: INFO nova.compute.manager [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Attaching volume 74e6a852-ec22-411d-a6a1-498a0c134970 to /dev/vdb
Aug 16 15:31:25 user nova-compute[73091]: DEBUG os_brick.utils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a48f8-3834-41f0-95b5-126f9d7b91b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d365ce-7ece-45ac-865b-1a3d2714a93f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdff5a5-2956-4768-a8e0-8ebbfbfbea57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dcdf3f-d71f-4ecd-81fe-4573d7e2d0c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:31:26 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:31:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7da497-c412-4fa1-b9ec-332de64bfd70]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG os_brick.utils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:26 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating existing volume attachment record: da1f8853-30eb-4661-bf6e-1d302d0b7f4b {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:31:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:31:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=25.280406951904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 0711b8f0-7ae2-445e-8063-bac395d25f36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 154458da-2fd8-424f-9a2c-e253bc342379 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance bccac10d-9eaa-4371-9db9-5da725b0f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:31:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:31:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating instance_info_cache with network_info: [{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnqgiVWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:31 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e564c3-a250-4fd0-8c9a-2d6a7b3913ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:31:31 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2378f98-a1d7-45e2-bbf1-6e40c9630fe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578] added
Aug 16 15:31:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a06d1-d429-4379-b843-a97e5868c6fb]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff760a2-4c33-4df7-9241-ad99ebd04781]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnqgiVWS {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnqgiVWS" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e47763-4872-4817-9655-90623a90a4e9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnqgiVWS'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7de2390-03d9-4b4b-98e1-8ed507c3ff2c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1700dd40-262c-4ffb-acd4-0a462513d744]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d109a8e1-87e4-4c24-87bd-199aaed8351f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260]
Aug 16 15:31:32 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260] successful.
Aug 16 15:31:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd3096-0273-41e2-a22b-e8cb3f88acf7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f31eb-6174-4381-a2cb-01d4aa3c4494]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:32 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:32 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5765ac-204c-4c00-a7f1-6f67d6bd472c]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnqgiVWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26435616261626634', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435616261626634', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:31:33 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:33 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:31:33 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:31:33 user nova-compute[73091]:   <serial>27011614-550a-41a6-bf13-fede25ab4578</serial>
Aug 16 15:31:33 user nova-compute[73091]: </disk>
Aug 16 15:31:33 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No VIF found with MAC fa:16:3e:b9:07:29, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:31:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a31a023f-0bea-4e9f-b618-a82bd58bac08 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.794s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcBSzFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:39 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac31d95-0c0a-4740-95c8-fb0c09611005]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:31:39 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e04bb64-5d27-4bcf-9c50-283ecbef2528]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970] added
Aug 16 15:31:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0016c09-9118-4561-82b5-984f98664850]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a8eae-1cae-4e12-be02-1040b82ec33e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygcBSzFt {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygcBSzFt" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5769463-86e3-41e2-ac77-bbd0f47a0564]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygcBSzFt'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5090f9f0-2471-4932-8e53-b0904452f102]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49e6b36-f6fc-48c2-afcf-31063b0473dd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2549a1-f634-4a05-bcfb-28030be87f88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260]
Aug 16 15:31:39 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260] successful.
Aug 16 15:31:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[321325ef-ee90-4255-9574-b1f500fabc8d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba6945-4c2d-4692-aa7b-d6f186a98168]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[32428605-9f45-4cc9-947b-503f0fea3f5d]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:40 user nova-compute[73091]: INFO nova.compute.manager [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attaching volume 2336382e-3871-47a1-bd6c-030e0363402d to /dev/vdc
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c27d8-a547-461d-b854-3adc51cf4ac4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a66ba-de3c-4a8c-acc9-55013dacaf20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aaa63d-1ee5-40ab-b306-476626b67334]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a119a-b266-4224-be88-d60dc990936b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:31:40 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:31:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b1e234-8767-413d-a800-c9682bdf374d]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating existing volume attachment record: 83cef8a9-4202-4e8c-b556-15ea89c0d993 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcBSzFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26535383232366332', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535383232366332', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:31:40 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:40 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:31:40 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:31:40 user nova-compute[73091]:   <serial>74e6a852-ec22-411d-a6a1-498a0c134970</serial>
Aug 16 15:31:40 user nova-compute[73091]: </disk>
Aug 16 15:31:40 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:31:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:52:9d:62, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:31:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5fe0320f-82d8-453b-8ce4-171bd53db2a4 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.502s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:31:45 user nova-compute[73091]: INFO nova.compute.claims [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Claim successful on node user
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-changed-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Refreshing instance network info cache due to event network-changed-8e23be71-643c-4893-ad6f-188af8faa2eb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] Acquiring lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] Acquired lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Refreshing network info cache for port 8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:31:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:31:45 user nova-compute[73091]: DEBUG nova.policy [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '043ba186a9b4416c903393c25a4a87d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62db39d6754641d89841f031b210383b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updated VIF entry in instance network info cache for port 8e23be71-643c-4893-ad6f-188af8faa2eb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:31:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Creating image(s)
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-acd86d6f-ca9b-4877-b2f3-746a53e8d0c8 req-8aa4306e-5cd9-4112-bd86-e744f77e532d service nova] Releasing lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk 1073741824" returned: 0 in 0.220s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.414s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Successfully created port: 4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.233s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:31:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Cannot resize image /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'migration_context' on Instance uuid e6fe68e1-e795-402b-8b18-a6069722eabe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Ensure instance console log exists: /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Successfully updated port: 4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquired lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-changed-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Refreshing instance network info cache due to event network-changed-4f64e912-9aaf-44f5-9d49-45c7a5143b13. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] Acquiring lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:31:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updating instance_info_cache with network_info: [{"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Releasing lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Instance network_info: |[{"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] Acquired lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Refreshing network info cache for port 4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Start _get_guest_xml network_info=[{"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:31:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:31:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-445472109',display_name='tempest-AttachVolumeNegativeTest-server-445472109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-445472109',id=46,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBRfv/Rz7sjOTdNajMRCz9AwtktoxH2vNDSJ8ddUxCZt0P/36n76livRqkJd+NahDzmAvTVDt24poW9yz5N/OK68ZMlQf9QOXtWLSo81anKAkQMgwKazkd/xyZbvA1PUA==',key_name='tempest-keypair-1966010297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-uw963n9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=e6fe68e1-e795-402b-8b18-a6069722eabe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'pci_devices' on Instance uuid e6fe68e1-e795-402b-8b18-a6069722eabe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:31:48 user nova-compute[73091]:   <uuid>e6fe68e1-e795-402b-8b18-a6069722eabe</uuid>
Aug 16 15:31:48 user nova-compute[73091]:   <name>instance-0000002e</name>
Aug 16 15:31:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:31:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:31:48 user nova-compute[73091]:   <metadata>
Aug 16 15:31:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:31:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:31:48 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-445472109</nova:name>
Aug 16 15:31:48 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:31:48</nova:creationTime>
Aug 16 15:31:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:31:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:31:48 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:31:48 user nova-compute[73091]:       <nova:owner>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:user uuid="043ba186a9b4416c903393c25a4a87d6">tempest-AttachVolumeNegativeTest-2024154116-project-member</nova:user>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:project uuid="62db39d6754641d89841f031b210383b">tempest-AttachVolumeNegativeTest-2024154116</nova:project>
Aug 16 15:31:48 user nova-compute[73091]:       </nova:owner>
Aug 16 15:31:48 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:31:48 user nova-compute[73091]:       <nova:ports>
Aug 16 15:31:48 user nova-compute[73091]:         <nova:port uuid="4f64e912-9aaf-44f5-9d49-45c7a5143b13">
Aug 16 15:31:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 15:31:48 user nova-compute[73091]:         </nova:port>
Aug 16 15:31:48 user nova-compute[73091]:       </nova:ports>
Aug 16 15:31:48 user nova-compute[73091]:     </nova:instance>
Aug 16 15:31:48 user nova-compute[73091]:   </metadata>
Aug 16 15:31:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:31:48 user nova-compute[73091]:     <system>
Aug 16 15:31:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:31:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:31:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:31:48 user nova-compute[73091]:       <entry name="serial">e6fe68e1-e795-402b-8b18-a6069722eabe</entry>
Aug 16 15:31:48 user nova-compute[73091]:       <entry name="uuid">e6fe68e1-e795-402b-8b18-a6069722eabe</entry>
Aug 16 15:31:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:31:48 user nova-compute[73091]:     </system>
Aug 16 15:31:48 user nova-compute[73091]:   </sysinfo>
Aug 16 15:31:48 user nova-compute[73091]:   <os>
Aug 16 15:31:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:31:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:31:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:31:48 user nova-compute[73091]:   </os>
Aug 16 15:31:48 user nova-compute[73091]:   <features>
Aug 16 15:31:48 user nova-compute[73091]:     <acpi/>
Aug 16 15:31:48 user nova-compute[73091]:     <apic/>
Aug 16 15:31:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:31:48 user nova-compute[73091]:   </features>
Aug 16 15:31:48 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:31:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:31:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:31:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:31:48 user nova-compute[73091]:   </clock>
Aug 16 15:31:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:31:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:31:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:31:48 user nova-compute[73091]:   </cpu>
Aug 16 15:31:48 user nova-compute[73091]:   <devices>
Aug 16 15:31:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:31:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:31:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk"/>
Aug 16 15:31:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:31:48 user nova-compute[73091]:     </disk>
Aug 16 15:31:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:31:48 user nova-compute[73091]:       <mac address="fa:16:3e:9c:a8:34"/>
Aug 16 15:31:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:31:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:31:48 user nova-compute[73091]:       <target dev="tap4f64e912-9a"/>
Aug 16 15:31:48 user nova-compute[73091]:     </interface>
Aug 16 15:31:48 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:31:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/console.log" append="off"/>
Aug 16 15:31:48 user nova-compute[73091]:     </serial>
Aug 16 15:31:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:31:48 user nova-compute[73091]:     <video>
Aug 16 15:31:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:31:48 user nova-compute[73091]:     </video>
Aug 16 15:31:48 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:31:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:31:48 user nova-compute[73091]:     </rng>
Aug 16 15:31:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:31:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:31:48 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:31:48 user nova-compute[73091]:     </memballoon>
Aug 16 15:31:48 user nova-compute[73091]:   </devices>
Aug 16 15:31:48 user nova-compute[73091]: </domain>
Aug 16 15:31:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-445472109',display_name='tempest-AttachVolumeNegativeTest-server-445472109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-445472109',id=46,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBRfv/Rz7sjOTdNajMRCz9AwtktoxH2vNDSJ8ddUxCZt0P/36n76livRqkJd+NahDzmAvTVDt24poW9yz5N/OK68ZMlQf9QOXtWLSo81anKAkQMgwKazkd/xyZbvA1PUA==',key_name='tempest-keypair-1966010297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-uw963n9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=e6fe68e1-e795-402b-8b18-a6069722eabe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG os_vif [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f64e912-9a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f64e912-9a, col_values=(('external_ids', {'iface-id': '4f64e912-9aaf-44f5-9d49-45c7a5143b13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:a8:34', 'vm-uuid': 'e6fe68e1-e795-402b-8b18-a6069722eabe'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:48 user nova-compute[73091]: INFO os_vif [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a')
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:9c:a8:34, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updated VIF entry in instance network info cache for port 4f64e912-9aaf-44f5-9d49-45c7a5143b13. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updating instance_info_cache with network_info: [{"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:31:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2cd1c42a-a793-4326-a299-c753db240b5c req-527c912e-046b-4f90-aad9-38d5c7303936 service nova] Releasing lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-08d2d0e5-85aa-4d27-83f2-d57d619939d3 req-e9055420-f800-4fd2-9941-37976825db18 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08d2d0e5-85aa-4d27-83f2-d57d619939d3 req-e9055420-f800-4fd2-9941-37976825db18 service nova] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08d2d0e5-85aa-4d27-83f2-d57d619939d3 req-e9055420-f800-4fd2-9941-37976825db18 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08d2d0e5-85aa-4d27-83f2-d57d619939d3 req-e9055420-f800-4fd2-9941-37976825db18 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-08d2d0e5-85aa-4d27-83f2-d57d619939d3 req-e9055420-f800-4fd2-9941-37976825db18 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] No waiting events found dispatching network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:31:49 user nova-compute[73091]: WARNING nova.compute.manager [req-08d2d0e5-85aa-4d27-83f2-d57d619939d3 req-e9055420-f800-4fd2-9941-37976825db18 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received unexpected event network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 for instance with vm_state building and task_state spawning.
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWFNPAdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:51 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:51 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:51 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26791cf8-009d-4dc4-b1b3-65361243929b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:31:51 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb1a7aa-42a1-4023-ab64-8c693e683773]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d] added
Aug 16 15:31:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff264b-26d1-4f1b-824b-59f78d0e41f3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4ebbc-706b-4695-84b1-2a531071df24]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWFNPAdZ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWFNPAdZ" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f23d7-7aed-4f20-bc68-b004b66b17d7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWFNPAdZ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[286cc7eb-2bbe-4de5-aa6e-8954559e9e65]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c7e1ff-6d6d-4334-bc93-a9db5fa45a50]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[070b7c1e-da7b-47e0-81b1-536edfdf0a5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260]
Aug 16 15:31:51 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260] successful.
Aug 16 15:31:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe9428-6a29-45cd-a9dc-86b47239807e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416d256-558b-4de7-836c-a7324cdf9bc0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)
Aug 16 15:31:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:51 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)
Aug 16 15:31:51 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c512e54-d9dc-40b1-88f0-c2002ab89163]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199911.6212893, e6fe68e1-e795-402b-8b18-a6069722eabe => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:31:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] VM Resumed (Lifecycle Event)
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:31:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Instance spawned successfully.
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:31:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199911.6229205, e6fe68e1-e795-402b-8b18-a6069722eabe => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:31:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] VM Started (Lifecycle Event)
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:31:51 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:31:51 user nova-compute[73091]: INFO nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-9797d2e8-8cf2-44fa-b90e-3aa6d43bcaac req-2ea9de54-6ebc-4637-b6f1-467ff56ae2b7 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9797d2e8-8cf2-44fa-b90e-3aa6d43bcaac req-2ea9de54-6ebc-4637-b6f1-467ff56ae2b7 service nova] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9797d2e8-8cf2-44fa-b90e-3aa6d43bcaac req-2ea9de54-6ebc-4637-b6f1-467ff56ae2b7 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9797d2e8-8cf2-44fa-b90e-3aa6d43bcaac req-2ea9de54-6ebc-4637-b6f1-467ff56ae2b7 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-9797d2e8-8cf2-44fa-b90e-3aa6d43bcaac req-2ea9de54-6ebc-4637-b6f1-467ff56ae2b7 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] No waiting events found dispatching network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:31:51 user nova-compute[73091]: WARNING nova.compute.manager [req-9797d2e8-8cf2-44fa-b90e-3aa6d43bcaac req-2ea9de54-6ebc-4637-b6f1-467ff56ae2b7 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received unexpected event network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 for instance with vm_state building and task_state spawning.
Aug 16 15:31:52 user nova-compute[73091]: INFO nova.compute.manager [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Took 6.55 seconds to build instance.
Aug 16 15:31:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3ae7d571-2b0a-4356-aaf3-9c46c0068f39 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWFNPAdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23964656534333535', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964656534333535', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:31:52 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:52 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:31:52 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:31:52 user nova-compute[73091]:   <serial>2336382e-3871-47a1-bd6c-030e0363402d</serial>
Aug 16 15:31:52 user nova-compute[73091]: </disk>
Aug 16 15:31:52 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] No VIF found with MAC fa:16:3e:b9:07:29, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce8e-0118-4a10-8844-ede0f40f8d01 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.826s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:53 user nova-compute[73091]: INFO nova.compute.manager [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Detaching volume 27011614-550a-41a6-bf13-fede25ab4578
Aug 16 15:31:53 user nova-compute[73091]: INFO nova.virt.block_device [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attempting to driver detach volume 27011614-550a-41a6-bf13-fede25ab4578 from mountpoint /dev/vdb
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Attempting to detach device vdb from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:31:53 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:53 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:31:53 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:31:53 user nova-compute[73091]:   <serial>27011614-550a-41a6-bf13-fede25ab4578</serial>
Aug 16 15:31:53 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:31:53 user nova-compute[73091]: </disk>
Aug 16 15:31:53 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:31:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully detached device vdb from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the persistent domain config.
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:31:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:31:53 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:53 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:31:53 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:31:53 user nova-compute[73091]:   <serial>27011614-550a-41a6-bf13-fede25ab4578</serial>
Aug 16 15:31:53 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:31:53 user nova-compute[73091]: </disk>
Aug 16 15:31:53 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199914.293549, 0711b8f0-7ae2-445e-8063-bac395d25f36 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:31:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully detached device vdb from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the live domain config.
Aug 16 15:31:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnqgiVWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:54 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb84470-1109-4095-8d0d-f221b3ce589c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a78405-c322-4afb-87fb-9db632ae70cd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:54 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:54 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:54 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)
Aug 16 15:31:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:54 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 (non-flash)
Aug 16 15:31:54 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:54 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)
Aug 16 15:31:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c526b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[774e6dd5-157f-4e8c-a7ba-f9060e525f84]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea884563-5a4a-4926-bbac-dd47e2ca4854]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13682ae7-0d82-4de4-9da9-851f09c4f1b5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4341f4-9fa6-460c-8e66-a5c1bb0352f1]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a87d9-69b9-4256-a637-1f1fae626729]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda2b79-1b41-46f1-a810-8bb6f47d0d42]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260]
Aug 16 15:31:54 user nova-compute[73091]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578, portal: 172.16.0.220,3260] successful.
Aug 16 15:31:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27011614-550a-41a6-bf13-fede25ab4578 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e8ca4c-797e-4073-8b39-a33fc9001d06]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== disconnect_volume: return (310ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:31:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dc4948b0-2043-4a6f-91b0-e7a99ba12496 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.734s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:56 user nova-compute[73091]: INFO nova.compute.manager [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Detaching volume 2336382e-3871-47a1-bd6c-030e0363402d
Aug 16 15:31:56 user nova-compute[73091]: INFO nova.virt.block_device [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Attempting to driver detach volume 2336382e-3871-47a1-bd6c-030e0363402d from mountpoint /dev/vdc
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Attempting to detach device vdc from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:31:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:56 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:31:56 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:31:56 user nova-compute[73091]:   <serial>2336382e-3871-47a1-bd6c-030e0363402d</serial>
Aug 16 15:31:56 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 15:31:56 user nova-compute[73091]: </disk>
Aug 16 15:31:56 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:31:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully detached device vdc from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the persistent domain config.
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:31:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:31:56 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 15:31:56 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:31:56 user nova-compute[73091]:   <serial>2336382e-3871-47a1-bd6c-030e0363402d</serial>
Aug 16 15:31:56 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 15:31:56 user nova-compute[73091]: </disk>
Aug 16 15:31:56 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692199916.8415895, 0711b8f0-7ae2-445e-8063-bac395d25f36 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:31:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully detached device vdc from instance 0711b8f0-7ae2-445e-8063-bac395d25f36 from the live domain config.
Aug 16 15:31:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWFNPAdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:31:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51a4d10-e325-4326-b90c-c41131bdf32e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7c132-f972-4cc6-80c5-3da9216bb2f3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:56 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:56 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)
Aug 16 15:31:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:31:56 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:31:56 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d (non-flash)
Aug 16 15:31:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11543dff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c818343f-61a8-44eb-8921-b9aadb845217]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[530243c9-4f43-4c90-941a-954318f42715]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ddb99-fc81-405e-bf15-c30715695dd0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:31:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[061dbbf3-85fb-47e4-a6fb-bb5c3bf18f05]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[df602f1e-37d9-4aa9-995d-8d620d1bdf55]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5644dd54-2f26-4aa2-9933-dc6762505a55]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260]
Aug 16 15:31:57 user nova-compute[73091]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d, portal: 172.16.0.220,3260] successful.
Aug 16 15:31:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2336382e-3871-47a1-bd6c-030e0363402d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82db47a2-5b55-4cc8-9a6b-737229ab2e27]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] <== disconnect_volume: return (297ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:31:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'flavor' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57a357ff-ffe7-4d69-89a3-a2548edb81e6 tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.899s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:58 user nova-compute[73091]: INFO nova.compute.manager [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Terminating instance
Aug 16 15:31:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-db6b8edf-0078-48fc-b388-02cfb5fecb92 req-590a8960-0fa5-4ef8-b885-4e5b86ef3acf service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-vif-unplugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db6b8edf-0078-48fc-b388-02cfb5fecb92 req-590a8960-0fa5-4ef8-b885-4e5b86ef3acf service nova] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db6b8edf-0078-48fc-b388-02cfb5fecb92 req-590a8960-0fa5-4ef8-b885-4e5b86ef3acf service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db6b8edf-0078-48fc-b388-02cfb5fecb92 req-590a8960-0fa5-4ef8-b885-4e5b86ef3acf service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-db6b8edf-0078-48fc-b388-02cfb5fecb92 req-590a8960-0fa5-4ef8-b885-4e5b86ef3acf service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] No waiting events found dispatching network-vif-unplugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-db6b8edf-0078-48fc-b388-02cfb5fecb92 req-590a8960-0fa5-4ef8-b885-4e5b86ef3acf service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-vif-unplugged-cb1b694f-08bc-4dee-b50a-9444589f921c for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.compute.claims [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Claim successful on node user
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Instance destroyed successfully.
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lazy-loading 'resources' on Instance uuid 0711b8f0-7ae2-445e-8063-bac395d25f36 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-739938890',display_name='tempest-AttachVolumeTestJSON-server-739938890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-739938890',id=43,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSR2jMNmYBeDaDfP1hXvRTWKz96GketG3OXObwKcc1A4bizKMySyNjASxRKQ40qRuya0VHSCLZOOnQUeLQUSdJUbjn9Uz2uUesDMX2hZldbSIJ70fi5fy5WDi3y9rsd7g==',key_name='tempest-keypair-709513372',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:29:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d9fa8ad962c43d4997806056d83f4a4',ramdisk_id='',reservation_id='r-51bww9at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1875838463',owner_user_name='tempest-AttachVolumeTestJSON-1875838463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4323609874c6400a986d1041316e8e78',uuid=0711b8f0-7ae2-445e-8063-bac395d25f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converting VIF {"id": "cb1b694f-08bc-4dee-b50a-9444589f921c", "address": "fa:16:3e:b9:07:29", "network": {"id": "f495b558-0f18-4db4-a0df-6bc7915a5da1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1366372465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9fa8ad962c43d4997806056d83f4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1b694f-08", "ovs_interfaceid": "cb1b694f-08bc-4dee-b50a-9444589f921c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG os_vif [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb1b694f-08, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:31:59 user nova-compute[73091]: INFO os_vif [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:29,bridge_name='br-int',has_traffic_filtering=True,id=cb1b694f-08bc-4dee-b50a-9444589f921c,network=Network(f495b558-0f18-4db4-a0df-6bc7915a5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1b694f-08')
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Deleting instance files /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36_del
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Deletion of /opt/stack/data/nova/instances/0711b8f0-7ae2-445e-8063-bac395d25f36_del complete
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.compute.manager [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:31:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:31:59 user nova-compute[73091]: INFO nova.virt.block_device [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Booting with volume 61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee at /dev/vda
Aug 16 15:32:00 user nova-compute[73091]: DEBUG nova.policy [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab71a5471a4bbcb7845d1293849449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f7da218a484e86a7c25626b2e178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2872e6f-8f08-4b58-9dec-01f7f3273bd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a302a-2d6d-4472-9f33-7a44686d93e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee56de-99ee-4db2-8b3a-e3597fcdb16a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed7f9b-95f4-49f7-8353-ada84348f766]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:32:00 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:32:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79274c9-c842-435a-9c0c-60b305e58507]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updating existing volume attachment record: 6eda6050-95eb-4a4d-b2e6-10e38ec46400 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:32:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Successfully created port: 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-16044fe5-2b6c-4344-a26f-012187d48312 req-bef16732-abbe-454b-b263-f0974a9bf715 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16044fe5-2b6c-4344-a26f-012187d48312 req-bef16732-abbe-454b-b263-f0974a9bf715 service nova] Acquiring lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16044fe5-2b6c-4344-a26f-012187d48312 req-bef16732-abbe-454b-b263-f0974a9bf715 service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16044fe5-2b6c-4344-a26f-012187d48312 req-bef16732-abbe-454b-b263-f0974a9bf715 service nova] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-16044fe5-2b6c-4344-a26f-012187d48312 req-bef16732-abbe-454b-b263-f0974a9bf715 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] No waiting events found dispatching network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:32:01 user nova-compute[73091]: WARNING nova.compute.manager [req-16044fe5-2b6c-4344-a26f-012187d48312 req-bef16732-abbe-454b-b263-f0974a9bf715 service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received unexpected event network-vif-plugged-cb1b694f-08bc-4dee-b50a-9444589f921c for instance with vm_state active and task_state deleting.
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Successfully updated port: 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquired lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-changed-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Refreshing instance network info cache due to event network-changed-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] Acquiring lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:32:01 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Took 1.78 seconds to deallocate network for instance.
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd66074a-4d0e-427b-9ccc-51a81eaa755a req-036bc072-7843-40fa-a141-e1652e59f49b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Received event network-vif-deleted-cb1b694f-08bc-4dee-b50a-9444589f921c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:32:01 user nova-compute[73091]: INFO nova.compute.manager [req-bd66074a-4d0e-427b-9ccc-51a81eaa755a req-036bc072-7843-40fa-a141-e1652e59f49b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Neutron deleted interface cb1b694f-08bc-4dee-b50a-9444589f921c; detaching it from the instance and deleting it from the info cache
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-bd66074a-4d0e-427b-9ccc-51a81eaa755a req-036bc072-7843-40fa-a141-e1652e59f49b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd66074a-4d0e-427b-9ccc-51a81eaa755a req-036bc072-7843-40fa-a141-e1652e59f49b service nova] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Detach interface failed, port_id=cb1b694f-08bc-4dee-b50a-9444589f921c, reason: Instance 0711b8f0-7ae2-445e-8063-bac395d25f36 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updating instance_info_cache with network_info: [{"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Releasing lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Instance network_info: |[{"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] Acquired lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:32:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Refreshing network info cache for port 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:32:01 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Deleted allocations for instance 0711b8f0-7ae2-445e-8063-bac395d25f36
Aug 16 15:32:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7a4aa312-5b78-43c8-b909-d01d1e66394d tempest-AttachVolumeTestJSON-1875838463 tempest-AttachVolumeTestJSON-1875838463-project-member] Lock "0711b8f0-7ae2-445e-8063-bac395d25f36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.088s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updated VIF entry in instance network info cache for port 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:32:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updating instance_info_cache with network_info: [{"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:32:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3b91da65-4056-4d16-86cf-e4ae3a469c9d req-487c16a2-70e3-4d28-9ade-51d5a708d98d service nova] Releasing lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:32:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:32:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Creating image(s)
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Ensure instance console log exists: /opt/stack/data/nova/instances/4dbbc4fb-7f0f-43a8-a533-beea8b0795e7/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Start _get_guest_xml network_info=[{"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '6eda6050-95eb-4a4d-b2e6-10e38ec46400', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEjuINtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4dbbc4fb-7f0f-43a8-a533-beea8b0795e7', 'attached_at': '', 'detached_at': '', 'volume_id': '61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee', 'serial': '61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:32:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:32:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEjuINtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:32:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:32:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:32:10 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fe8aff-4632-4a1b-af4b-d814f827b231]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:32:10 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f7569a-970d-4770-a240-38e0a86f4f09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee] added
Aug 16 15:32:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc733c-d80b-44b3-8e87-d381d2155ffd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2253c3d9-1048-44ff-918d-4147947a97a3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cEjuINtM {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cEjuINtM" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b473a4c0-40ab-4595-921e-d524c169c938]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cEjuINtM'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0be351-db29-420a-be3c-c7a0813c2c33]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aee795-5cb2-4ee6-b169-0903b43a66c5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:32:11 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:32:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:32:11 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:32:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e3975-eedb-4370-bb6d-e6a231693d89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260]
Aug 16 15:32:11 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260] successful.
Aug 16 15:32:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57992085-1a3d-4e6a-80c1-1ff716fb3a8a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9940ed58-1b2a-4c51-aea6-07a4bbc595c0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:32:11 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:32:11 user nova-compute[73091]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee (non-flash)
Aug 16 15:32:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:32:11 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:32:11 user nova-compute[73091]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee (non-flash)
Aug 16 15:32:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8365c614-6a2f-4e99-856c-656a37dac719]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:32:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEjuINtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26464303865653664', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464303865653664', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-175717796',display_name='tempest-TestVolumeBootPattern-server-175717796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-175717796',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-tihxhtdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:32:00Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=4dbbc4fb-7f0f-43a8-a533-beea8b0795e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:32:12 user nova-compute[73091]:   <uuid>4dbbc4fb-7f0f-43a8-a533-beea8b0795e7</uuid>
Aug 16 15:32:12 user nova-compute[73091]:   <name>instance-0000002f</name>
Aug 16 15:32:12 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:32:12 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:32:12 user nova-compute[73091]:   <metadata>
Aug 16 15:32:12 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:32:12 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:32:12 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-175717796</nova:name>
Aug 16 15:32:12 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:32:10</nova:creationTime>
Aug 16 15:32:12 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:32:12 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:32:12 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:32:12 user nova-compute[73091]:       <nova:owner>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:user uuid="b8ab71a5471a4bbcb7845d1293849449">tempest-TestVolumeBootPattern-1172028538-project-member</nova:user>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:project uuid="1236f7da218a484e86a7c25626b2e178">tempest-TestVolumeBootPattern-1172028538</nova:project>
Aug 16 15:32:12 user nova-compute[73091]:       </nova:owner>
Aug 16 15:32:12 user nova-compute[73091]:       <nova:ports>
Aug 16 15:32:12 user nova-compute[73091]:         <nova:port uuid="7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8">
Aug 16 15:32:12 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:32:12 user nova-compute[73091]:         </nova:port>
Aug 16 15:32:12 user nova-compute[73091]:       </nova:ports>
Aug 16 15:32:12 user nova-compute[73091]:     </nova:instance>
Aug 16 15:32:12 user nova-compute[73091]:   </metadata>
Aug 16 15:32:12 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:32:12 user nova-compute[73091]:     <system>
Aug 16 15:32:12 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:32:12 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:32:12 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:32:12 user nova-compute[73091]:       <entry name="serial">4dbbc4fb-7f0f-43a8-a533-beea8b0795e7</entry>
Aug 16 15:32:12 user nova-compute[73091]:       <entry name="uuid">4dbbc4fb-7f0f-43a8-a533-beea8b0795e7</entry>
Aug 16 15:32:12 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:32:12 user nova-compute[73091]:     </system>
Aug 16 15:32:12 user nova-compute[73091]:   </sysinfo>
Aug 16 15:32:12 user nova-compute[73091]:   <os>
Aug 16 15:32:12 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:32:12 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:32:12 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:32:12 user nova-compute[73091]:   </os>
Aug 16 15:32:12 user nova-compute[73091]:   <features>
Aug 16 15:32:12 user nova-compute[73091]:     <acpi/>
Aug 16 15:32:12 user nova-compute[73091]:     <apic/>
Aug 16 15:32:12 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:32:12 user nova-compute[73091]:   </features>
Aug 16 15:32:12 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:32:12 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:32:12 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:32:12 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:32:12 user nova-compute[73091]:   </clock>
Aug 16 15:32:12 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:32:12 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:32:12 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:32:12 user nova-compute[73091]:   </cpu>
Aug 16 15:32:12 user nova-compute[73091]:   <devices>
Aug 16 15:32:12 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:32:12 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:32:12 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 15:32:12 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:32:12 user nova-compute[73091]:       <serial>61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee</serial>
Aug 16 15:32:12 user nova-compute[73091]:     </disk>
Aug 16 15:32:12 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:32:12 user nova-compute[73091]:       <mac address="fa:16:3e:76:eb:09"/>
Aug 16 15:32:12 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:32:12 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:32:12 user nova-compute[73091]:       <target dev="tap7b4e1635-0d"/>
Aug 16 15:32:12 user nova-compute[73091]:     </interface>
Aug 16 15:32:12 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:32:12 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4dbbc4fb-7f0f-43a8-a533-beea8b0795e7/console.log" append="off"/>
Aug 16 15:32:12 user nova-compute[73091]:     </serial>
Aug 16 15:32:12 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:32:12 user nova-compute[73091]:     <video>
Aug 16 15:32:12 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:32:12 user nova-compute[73091]:     </video>
Aug 16 15:32:12 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:32:12 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:32:12 user nova-compute[73091]:     </rng>
Aug 16 15:32:12 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:32:12 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:32:12 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:32:12 user nova-compute[73091]:     </memballoon>
Aug 16 15:32:12 user nova-compute[73091]:   </devices>
Aug 16 15:32:12 user nova-compute[73091]: </domain>
Aug 16 15:32:12 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-175717796',display_name='tempest-TestVolumeBootPattern-server-175717796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-175717796',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-tihxhtdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:32:00Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=4dbbc4fb-7f0f-43a8-a533-beea8b0795e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG os_vif [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b4e1635-0d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b4e1635-0d, col_values=(('external_ids', {'iface-id': '7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:eb:09', 'vm-uuid': '4dbbc4fb-7f0f-43a8-a533-beea8b0795e7'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:12 user nova-compute[73091]: INFO os_vif [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d')
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:32:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] No VIF found with MAC fa:16:3e:76:eb:09, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:32:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-9f8a3b66-7790-4430-8021-2224412b6bfc req-6064e9bd-88a7-4671-aacd-4123830d4bc3 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:32:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9f8a3b66-7790-4430-8021-2224412b6bfc req-6064e9bd-88a7-4671-aacd-4123830d4bc3 service nova] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9f8a3b66-7790-4430-8021-2224412b6bfc req-6064e9bd-88a7-4671-aacd-4123830d4bc3 service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9f8a3b66-7790-4430-8021-2224412b6bfc req-6064e9bd-88a7-4671-aacd-4123830d4bc3 service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-9f8a3b66-7790-4430-8021-2224412b6bfc req-6064e9bd-88a7-4671-aacd-4123830d4bc3 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] No waiting events found dispatching network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:32:14 user nova-compute[73091]: WARNING nova.compute.manager [req-9f8a3b66-7790-4430-8021-2224412b6bfc req-6064e9bd-88a7-4671-aacd-4123830d4bc3 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received unexpected event network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 for instance with vm_state building and task_state spawning.
Aug 16 15:32:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:14 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692199919.5663128, 0711b8f0-7ae2-445e-8063-bac395d25f36 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:32:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] VM Stopped (Lifecycle Event)
Aug 16 15:32:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-73f6383f-9b8d-443a-ac44-1a26d3ff50cc None None] [instance: 0711b8f0-7ae2-445e-8063-bac395d25f36] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199936.0311747, 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] VM Resumed (Lifecycle Event)
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Instance spawned successfully.
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692199936.0325768, 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] VM Started (Lifecycle Event)
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-20a55351-926d-4439-82dc-aeb63ea0daa7 req-250df997-a1bc-41ed-bd3d-cfa21b41dd0c service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-20a55351-926d-4439-82dc-aeb63ea0daa7 req-250df997-a1bc-41ed-bd3d-cfa21b41dd0c service nova] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-20a55351-926d-4439-82dc-aeb63ea0daa7 req-250df997-a1bc-41ed-bd3d-cfa21b41dd0c service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-20a55351-926d-4439-82dc-aeb63ea0daa7 req-250df997-a1bc-41ed-bd3d-cfa21b41dd0c service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-20a55351-926d-4439-82dc-aeb63ea0daa7 req-250df997-a1bc-41ed-bd3d-cfa21b41dd0c service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] No waiting events found dispatching network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:32:16 user nova-compute[73091]: WARNING nova.compute.manager [req-20a55351-926d-4439-82dc-aeb63ea0daa7 req-250df997-a1bc-41ed-bd3d-cfa21b41dd0c service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received unexpected event network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 for instance with vm_state building and task_state spawning.
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 16 15:32:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:32:16 user nova-compute[73091]: INFO nova.compute.manager [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Took 16.71 seconds to build instance.
Aug 16 15:32:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fa6a4aa9-b3a1-4122-93cd-5421bcc46703 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.809s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:32:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:32:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8316MB free_disk=25.27639389038086GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 154458da-2fd8-424f-9a2c-e253bc342379 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance bccac10d-9eaa-4371-9db9-5da725b0f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e6fe68e1-e795-402b-8b18-a6069722eabe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:32:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:32:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:32:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:32:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:32:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:33:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:33:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:33:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating instance_info_cache with network_info: [{"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-154458da-2fd8-424f-9a2c-e253bc342379" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:33:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:33:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=25.274654388427734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 154458da-2fd8-424f-9a2c-e253bc342379 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance bccac10d-9eaa-4371-9db9-5da725b0f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance e6fe68e1-e795-402b-8b18-a6069722eabe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:33:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-changed-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Refreshing instance network info cache due to event network-changed-4f64e912-9aaf-44f5-9d49-45c7a5143b13. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:33:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] Acquiring lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:33:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] Acquired lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:33:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Refreshing network info cache for port 4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updated VIF entry in instance network info cache for port 4f64e912-9aaf-44f5-9d49-45c7a5143b13. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updating instance_info_cache with network_info: [{"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f474cbe7-753e-4d5c-b8dd-bed6cb73b13c req-9c96c261-e462-4796-9554-a4b93c158809 service nova] Releasing lock "refresh_cache-e6fe68e1-e795-402b-8b18-a6069722eabe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:37 user nova-compute[73091]: INFO nova.compute.manager [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Terminating instance
Aug 16 15:33:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-726aaa08-7af2-4b2f-ab4f-25d572910261 req-766456d9-bb36-4c7b-8639-b50b7eed69d0 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-vif-unplugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-726aaa08-7af2-4b2f-ab4f-25d572910261 req-766456d9-bb36-4c7b-8639-b50b7eed69d0 service nova] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-726aaa08-7af2-4b2f-ab4f-25d572910261 req-766456d9-bb36-4c7b-8639-b50b7eed69d0 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-726aaa08-7af2-4b2f-ab4f-25d572910261 req-766456d9-bb36-4c7b-8639-b50b7eed69d0 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-726aaa08-7af2-4b2f-ab4f-25d572910261 req-766456d9-bb36-4c7b-8639-b50b7eed69d0 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] No waiting events found dispatching network-vif-unplugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:33:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-726aaa08-7af2-4b2f-ab4f-25d572910261 req-766456d9-bb36-4c7b-8639-b50b7eed69d0 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-vif-unplugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Instance destroyed successfully.
Aug 16 15:33:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'resources' on Instance uuid e6fe68e1-e795-402b-8b18-a6069722eabe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-445472109',display_name='tempest-AttachVolumeNegativeTest-server-445472109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-445472109',id=46,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBRfv/Rz7sjOTdNajMRCz9AwtktoxH2vNDSJ8ddUxCZt0P/36n76livRqkJd+NahDzmAvTVDt24poW9yz5N/OK68ZMlQf9QOXtWLSo81anKAkQMgwKazkd/xyZbvA1PUA==',key_name='tempest-keypair-1966010297',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-uw963n9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=e6fe68e1-e795-402b-8b18-a6069722eabe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "address": "fa:16:3e:9c:a8:34", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f64e912-9a", "ovs_interfaceid": "4f64e912-9aaf-44f5-9d49-45c7a5143b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG os_vif [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f64e912-9a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:33:38 user nova-compute[73091]: INFO os_vif [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=4f64e912-9aaf-44f5-9d49-45c7a5143b13,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f64e912-9a')
Aug 16 15:33:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Deleting instance files /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe_del
Aug 16 15:33:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Deletion of /opt/stack/data/nova/instances/e6fe68e1-e795-402b-8b18-a6069722eabe_del complete
Aug 16 15:33:38 user nova-compute[73091]: INFO nova.compute.manager [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 15:33:38 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:33:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:39 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Took 0.71 seconds to deallocate network for instance.
Aug 16 15:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d95f31d-ca53-4392-a9f2-5e4be1a25d52 req-d6a5d8c6-cf64-4760-bdb1-ff1d083d782e service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-vif-deleted-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:39 user nova-compute[73091]: INFO nova.compute.manager [req-1d95f31d-ca53-4392-a9f2-5e4be1a25d52 req-d6a5d8c6-cf64-4760-bdb1-ff1d083d782e service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Neutron deleted interface 4f64e912-9aaf-44f5-9d49-45c7a5143b13; detaching it from the instance and deleting it from the info cache
Aug 16 15:33:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-1d95f31d-ca53-4392-a9f2-5e4be1a25d52 req-d6a5d8c6-cf64-4760-bdb1-ff1d083d782e service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d95f31d-ca53-4392-a9f2-5e4be1a25d52 req-d6a5d8c6-cf64-4760-bdb1-ff1d083d782e service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Detach interface failed, port_id=4f64e912-9aaf-44f5-9d49-45c7a5143b13, reason: Instance e6fe68e1-e795-402b-8b18-a6069722eabe could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:39 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Deleted allocations for instance e6fe68e1-e795-402b-8b18-a6069722eabe
Aug 16 15:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28620c64-7f2d-4589-85ca-b96f22e5a171 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cb5b4c3-44f6-4582-88ec-32e7eba1f490 req-f8118ec1-c52e-4c2b-865e-8b34c4027ad7 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received event network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cb5b4c3-44f6-4582-88ec-32e7eba1f490 req-f8118ec1-c52e-4c2b-865e-8b34c4027ad7 service nova] Acquiring lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cb5b4c3-44f6-4582-88ec-32e7eba1f490 req-f8118ec1-c52e-4c2b-865e-8b34c4027ad7 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cb5b4c3-44f6-4582-88ec-32e7eba1f490 req-f8118ec1-c52e-4c2b-865e-8b34c4027ad7 service nova] Lock "e6fe68e1-e795-402b-8b18-a6069722eabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cb5b4c3-44f6-4582-88ec-32e7eba1f490 req-f8118ec1-c52e-4c2b-865e-8b34c4027ad7 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] No waiting events found dispatching network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:33:40 user nova-compute[73091]: WARNING nova.compute.manager [req-5cb5b4c3-44f6-4582-88ec-32e7eba1f490 req-f8118ec1-c52e-4c2b-865e-8b34c4027ad7 service nova] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Received unexpected event network-vif-plugged-4f64e912-9aaf-44f5-9d49-45c7a5143b13 for instance with vm_state deleted and task_state None.
Aug 16 15:33:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:33:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-changed-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Refreshing instance network info cache due to event network-changed-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] Acquiring lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] Acquired lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:33:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Refreshing network info cache for port 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:33:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updated VIF entry in instance network info cache for port 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:33:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updating instance_info_cache with network_info: [{"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05340124-39e7-4df6-ad6b-9c00882fbb69 req-47c5ce33-926e-4d32-b855-41f72d903d20 service nova] Releasing lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:53 user nova-compute[73091]: INFO nova.compute.manager [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Terminating instance
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200018.291578, e6fe68e1-e795-402b-8b18-a6069722eabe => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:33:53 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] VM Stopped (Lifecycle Event)
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3c5b396d-4830-4418-a739-2331b7f249dc None None] [instance: e6fe68e1-e795-402b-8b18-a6069722eabe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-changed-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Refreshing instance network info cache due to event network-changed-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Acquiring lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Acquired lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Refreshing network info cache for port 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:33:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Instance destroyed successfully.
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'resources' on Instance uuid 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-175717796',display_name='tempest-TestVolumeBootPattern-server-175717796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-175717796',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-tihxhtdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:32:16Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=4dbbc4fb-7f0f-43a8-a533-beea8b0795e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG os_vif [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b4e1635-0d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:33:53 user nova-compute[73091]: INFO os_vif [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:eb:09,bridge_name='br-int',has_traffic_filtering=True,id=7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4e1635-0d')
Aug 16 15:33:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEjuINtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:33:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:33:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ed496-94f5-4622-9d75-25084ebaf9b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[12071e61-b184-47a8-99c7-36810903ee7e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:33:54 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:33:54 user nova-compute[73091]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee (non-flash)
Aug 16 15:33:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:33:54 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:33:54 user nova-compute[73091]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee (non-flash)
Aug 16 15:33:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c58d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2745956-d820-4a77-8ced-553e5807b96f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ba19d-b6bf-4b3e-8a72-99a1a64a94bc]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa344b2-5d7c-488f-8bf4-558e3a8e5749]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85351de-0d68-48ad-9d0b-363c8a94454f]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb903690-7113-4adb-afcb-a955843ba2b0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4768f66-180b-475d-bc10-cf6a305cef9f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260]
Aug 16 15:33:54 user nova-compute[73091]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee, portal: 172.16.0.220,3260] successful.
Aug 16 15:33:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f1d9e7-89ce-4a86-99b9-7a6dbdaad9ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c288471-e59f-44af-8e05-2e787a65aff3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== disconnect_volume: return (293ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:33:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Deleting instance files /opt/stack/data/nova/instances/4dbbc4fb-7f0f-43a8-a533-beea8b0795e7_del
Aug 16 15:33:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Deletion of /opt/stack/data/nova/instances/4dbbc4fb-7f0f-43a8-a533-beea8b0795e7_del complete
Aug 16 15:33:54 user nova-compute[73091]: INFO nova.compute.manager [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updated VIF entry in instance network info cache for port 7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updating instance_info_cache with network_info: [{"id": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "address": "fa:16:3e:76:eb:09", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4e1635-0d", "ovs_interfaceid": "7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Releasing lock "refresh_cache-4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-vif-unplugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] No waiting events found dispatching network-vif-unplugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-vif-unplugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Acquiring lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] No waiting events found dispatching network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:33:54 user nova-compute[73091]: WARNING nova.compute.manager [req-537de1a7-010a-4bf7-867c-0eb9e7256ffd req-cc112515-181f-4f13-9965-b3f9fc970d03 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received unexpected event network-vif-plugged-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 for instance with vm_state active and task_state deleting.
Aug 16 15:33:55 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:33:55 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Took 1.46 seconds to deallocate network for instance.
Aug 16 15:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-719cbabd-b1c1-408b-af71-ebe2ea7ab08f req-a8282998-9575-4b36-8e5d-11c8c26e9669 service nova] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Received event network-vif-deleted-7b4e1635-0dbc-4ee9-a3c6-d72f1a8998b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:33:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:56 user nova-compute[73091]: INFO nova.compute.manager [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Took 0.76 seconds to detach 1 volumes for instance.
Aug 16 15:33:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:33:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:33:56 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:33:56 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:33:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:56 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Deleted allocations for instance 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7
Aug 16 15:33:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3fac9fb-e6c5-4b14-b9ad-4cb87a24a0a3 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "4dbbc4fb-7f0f-43a8-a533-beea8b0795e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.924s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:33:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:33:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:34:06 user nova-compute[73091]: INFO nova.compute.claims [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Claim successful on node user
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:34:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.policy [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b66d0459bf44f1e841c50ad6306f9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d18f962a84f8e86a7a7f58ec649b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:34:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Creating image(s)
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "/opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "/opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "/opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Successfully created port: fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Cannot resize image /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lazy-loading 'migration_context' on Instance uuid b06a376b-edd0-4f06-933b-c4a6de4ce394 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Ensure instance console log exists: /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Successfully updated port: fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-changed-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Refreshing instance network info cache due to event network-changed-fdb94544-9cc1-43a7-afef-be719da19183. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] Acquiring lock "refresh_cache-b06a376b-edd0-4f06-933b-c4a6de4ce394" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] Acquired lock "refresh_cache-b06a376b-edd0-4f06-933b-c4a6de4ce394" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Refreshing network info cache for port fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200033.9531574, 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:34:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] VM Stopped (Lifecycle Event)
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6075437-477c-448c-ae7d-c524c97564d3 None None] [instance: 4dbbc4fb-7f0f-43a8-a533-beea8b0795e7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "refresh_cache-b06a376b-edd0-4f06-933b-c4a6de4ce394" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ebbcabb-8eba-425d-91ce-cd60ed778a44 req-b14a3263-10eb-433a-b1a9-a80d6c377103 service nova] Releasing lock "refresh_cache-b06a376b-edd0-4f06-933b-c4a6de4ce394" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquired lock "refresh_cache-b06a376b-edd0-4f06-933b-c4a6de4ce394" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Updating instance_info_cache with network_info: [{"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Releasing lock "refresh_cache-b06a376b-edd0-4f06-933b-c4a6de4ce394" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Instance network_info: |[{"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Start _get_guest_xml network_info=[{"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:34:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:34:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-154288541',display_name='tempest-VolumesActionsTest-instance-154288541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-154288541',id=48,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='737d18f962a84f8e86a7a7f58ec649b1',ramdisk_id='',reservation_id='r-r0r4snag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-731337952',owner_user_name='tempest-VolumesActionsTest-731337952-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:34:07Z,user_data=None,user_id='2b66d0459bf44f1e841c50ad6306f9a7',uuid=b06a376b-edd0-4f06-933b-c4a6de4ce394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Converting VIF {"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lazy-loading 'pci_devices' on Instance uuid b06a376b-edd0-4f06-933b-c4a6de4ce394 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:34:09 user nova-compute[73091]:   <uuid>b06a376b-edd0-4f06-933b-c4a6de4ce394</uuid>
Aug 16 15:34:09 user nova-compute[73091]:   <name>instance-00000030</name>
Aug 16 15:34:09 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:34:09 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:34:09 user nova-compute[73091]:   <metadata>
Aug 16 15:34:09 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:34:09 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:34:09 user nova-compute[73091]:       <nova:name>tempest-VolumesActionsTest-instance-154288541</nova:name>
Aug 16 15:34:09 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:34:09</nova:creationTime>
Aug 16 15:34:09 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:34:09 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:34:09 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:34:09 user nova-compute[73091]:       <nova:owner>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:user uuid="2b66d0459bf44f1e841c50ad6306f9a7">tempest-VolumesActionsTest-731337952-project-member</nova:user>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:project uuid="737d18f962a84f8e86a7a7f58ec649b1">tempest-VolumesActionsTest-731337952</nova:project>
Aug 16 15:34:09 user nova-compute[73091]:       </nova:owner>
Aug 16 15:34:09 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:34:09 user nova-compute[73091]:       <nova:ports>
Aug 16 15:34:09 user nova-compute[73091]:         <nova:port uuid="fdb94544-9cc1-43a7-afef-be719da19183">
Aug 16 15:34:09 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:34:09 user nova-compute[73091]:         </nova:port>
Aug 16 15:34:09 user nova-compute[73091]:       </nova:ports>
Aug 16 15:34:09 user nova-compute[73091]:     </nova:instance>
Aug 16 15:34:09 user nova-compute[73091]:   </metadata>
Aug 16 15:34:09 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:34:09 user nova-compute[73091]:     <system>
Aug 16 15:34:09 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:34:09 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:34:09 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:34:09 user nova-compute[73091]:       <entry name="serial">b06a376b-edd0-4f06-933b-c4a6de4ce394</entry>
Aug 16 15:34:09 user nova-compute[73091]:       <entry name="uuid">b06a376b-edd0-4f06-933b-c4a6de4ce394</entry>
Aug 16 15:34:09 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:34:09 user nova-compute[73091]:     </system>
Aug 16 15:34:09 user nova-compute[73091]:   </sysinfo>
Aug 16 15:34:09 user nova-compute[73091]:   <os>
Aug 16 15:34:09 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:34:09 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:34:09 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:34:09 user nova-compute[73091]:   </os>
Aug 16 15:34:09 user nova-compute[73091]:   <features>
Aug 16 15:34:09 user nova-compute[73091]:     <acpi/>
Aug 16 15:34:09 user nova-compute[73091]:     <apic/>
Aug 16 15:34:09 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:34:09 user nova-compute[73091]:   </features>
Aug 16 15:34:09 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:34:09 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:34:09 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:34:09 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:34:09 user nova-compute[73091]:   </clock>
Aug 16 15:34:09 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:34:09 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:34:09 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:34:09 user nova-compute[73091]:   </cpu>
Aug 16 15:34:09 user nova-compute[73091]:   <devices>
Aug 16 15:34:09 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:34:09 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:34:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk"/>
Aug 16 15:34:09 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:34:09 user nova-compute[73091]:     </disk>
Aug 16 15:34:09 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:34:09 user nova-compute[73091]:       <mac address="fa:16:3e:9a:0b:0d"/>
Aug 16 15:34:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:34:09 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:34:09 user nova-compute[73091]:       <target dev="tapfdb94544-9c"/>
Aug 16 15:34:09 user nova-compute[73091]:     </interface>
Aug 16 15:34:09 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:34:09 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/console.log" append="off"/>
Aug 16 15:34:09 user nova-compute[73091]:     </serial>
Aug 16 15:34:09 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:34:09 user nova-compute[73091]:     <video>
Aug 16 15:34:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:34:09 user nova-compute[73091]:     </video>
Aug 16 15:34:09 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:34:09 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:34:09 user nova-compute[73091]:     </rng>
Aug 16 15:34:09 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:34:09 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:34:09 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:34:09 user nova-compute[73091]:     </memballoon>
Aug 16 15:34:09 user nova-compute[73091]:   </devices>
Aug 16 15:34:09 user nova-compute[73091]: </domain>
Aug 16 15:34:09 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-154288541',display_name='tempest-VolumesActionsTest-instance-154288541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-154288541',id=48,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='737d18f962a84f8e86a7a7f58ec649b1',ramdisk_id='',reservation_id='r-r0r4snag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-731337952',owner_user_name='tempest-VolumesActionsTest-731337952-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:34:07Z,user_data=None,user_id='2b66d0459bf44f1e841c50ad6306f9a7',uuid=b06a376b-edd0-4f06-933b-c4a6de4ce394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Converting VIF {"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG os_vif [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdb94544-9c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdb94544-9c, col_values=(('external_ids', {'iface-id': 'fdb94544-9cc1-43a7-afef-be719da19183', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:0b:0d', 'vm-uuid': 'b06a376b-edd0-4f06-933b-c4a6de4ce394'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:09 user nova-compute[73091]: INFO os_vif [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c')
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] No VIF found with MAC fa:16:3e:9a:0b:0d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:34:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc07df9b-ee6d-4742-a1de-58f5dd2848ca req-45ff5262-bc1b-45b2-b6d9-76b2beb843c5 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc07df9b-ee6d-4742-a1de-58f5dd2848ca req-45ff5262-bc1b-45b2-b6d9-76b2beb843c5 service nova] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc07df9b-ee6d-4742-a1de-58f5dd2848ca req-45ff5262-bc1b-45b2-b6d9-76b2beb843c5 service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc07df9b-ee6d-4742-a1de-58f5dd2848ca req-45ff5262-bc1b-45b2-b6d9-76b2beb843c5 service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc07df9b-ee6d-4742-a1de-58f5dd2848ca req-45ff5262-bc1b-45b2-b6d9-76b2beb843c5 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] No waiting events found dispatching network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:34:11 user nova-compute[73091]: WARNING nova.compute.manager [req-dc07df9b-ee6d-4742-a1de-58f5dd2848ca req-45ff5262-bc1b-45b2-b6d9-76b2beb843c5 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received unexpected event network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 for instance with vm_state building and task_state spawning.
Aug 16 15:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200052.9698207, b06a376b-edd0-4f06-933b-c4a6de4ce394 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:34:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] VM Resumed (Lifecycle Event)
Aug 16 15:34:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:34:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:34:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Instance spawned successfully.
Aug 16 15:34:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:34:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:34:13 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200052.9714484, b06a376b-edd0-4f06-933b-c4a6de4ce394 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:34:13 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] VM Started (Lifecycle Event)
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:34:13 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:34:13 user nova-compute[73091]: INFO nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9579d42-8793-43b1-aa16-bb35738c618d req-1edbe4e6-58d9-49ad-a37d-575a6c74afe2 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9579d42-8793-43b1-aa16-bb35738c618d req-1edbe4e6-58d9-49ad-a37d-575a6c74afe2 service nova] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9579d42-8793-43b1-aa16-bb35738c618d req-1edbe4e6-58d9-49ad-a37d-575a6c74afe2 service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9579d42-8793-43b1-aa16-bb35738c618d req-1edbe4e6-58d9-49ad-a37d-575a6c74afe2 service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9579d42-8793-43b1-aa16-bb35738c618d req-1edbe4e6-58d9-49ad-a37d-575a6c74afe2 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] No waiting events found dispatching network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:34:13 user nova-compute[73091]: WARNING nova.compute.manager [req-a9579d42-8793-43b1-aa16-bb35738c618d req-1edbe4e6-58d9-49ad-a37d-575a6c74afe2 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received unexpected event network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 for instance with vm_state building and task_state spawning.
Aug 16 15:34:13 user nova-compute[73091]: INFO nova.compute.manager [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Took 6.74 seconds to build instance.
Aug 16 15:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91ccbe04-d9e2-4323-91f4-30e10b965cbb tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.857s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:28 user nova-compute[73091]: INFO nova.compute.manager [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Detaching volume 74e6a852-ec22-411d-a6a1-498a0c134970
Aug 16 15:34:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Attempting to driver detach volume 74e6a852-ec22-411d-a6a1-498a0c134970 from mountpoint /dev/vdb
Aug 16 15:34:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Attempting to detach device vdb from instance 154458da-2fd8-424f-9a2c-e253bc342379 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:34:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:34:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:34:28 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:34:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:34:28 user nova-compute[73091]:   <serial>74e6a852-ec22-411d-a6a1-498a0c134970</serial>
Aug 16 15:34:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:34:28 user nova-compute[73091]: </disk>
Aug 16 15:34:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:34:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully detached device vdb from instance 154458da-2fd8-424f-9a2c-e253bc342379 from the persistent domain config.
Aug 16 15:34:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 154458da-2fd8-424f-9a2c-e253bc342379 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:34:29 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:34:29 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 15:34:29 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:34:29 user nova-compute[73091]:   <serial>74e6a852-ec22-411d-a6a1-498a0c134970</serial>
Aug 16 15:34:29 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:34:29 user nova-compute[73091]: </disk>
Aug 16 15:34:29 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692200069.4440699, 154458da-2fd8-424f-9a2c-e253bc342379 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:34:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully detached device vdb from instance 154458da-2fd8-424f-9a2c-e253bc342379 from the live domain config.
Aug 16 15:34:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygcBSzFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:34:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51acda84-676f-4cfc-835b-3fdff7636624]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b09dfa-9210-4e6c-8620-f7a6bc49e60a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:34:29 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:34:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:34:29 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 (non-flash)
Aug 16 15:34:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c3a85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87716aa-c4c4-4b7e-9107-55287ab21404]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19431fd-9c03-401c-9db2-4774df11447a]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef03ff8d-c676-4055-81ce-60601ff55062]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21af8b6c-27aa-47f9-84f0-fb658ee65789]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1880ce99-945b-4279-94b8-f3da783d20db]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf90ad46-4431-4e2e-967d-5fae2b5a7def]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260]
Aug 16 15:34:29 user nova-compute[73091]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970, portal: 172.16.0.220,3260] successful.
Aug 16 15:34:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e6a852-ec22-411d-a6a1-498a0c134970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76393e97-5025-46ec-9265-ea2edc9a24b1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== disconnect_volume: return (272ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:34:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:34:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:34:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf80925b-5a48-41d0-9f62-89b6eb38ef24 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:34:34 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.26465606689453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 154458da-2fd8-424f-9a2c-e253bc342379 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance bccac10d-9eaa-4371-9db9-5da725b0f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b06a376b-edd0-4f06-933b-c4a6de4ce394 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:34:34 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:34:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:34:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:34:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:34:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:34:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:34:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-changed-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Refreshing instance network info cache due to event network-changed-8e23be71-643c-4893-ad6f-188af8faa2eb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] Acquiring lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] Acquired lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Refreshing network info cache for port 8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:55 user nova-compute[73091]: INFO nova.compute.manager [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Terminating instance
Aug 16 15:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updated VIF entry in instance network info cache for port 8e23be71-643c-4893-ad6f-188af8faa2eb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [{"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-a5d038ea-d71a-4331-8539-df72066421a1 req-d8d95f68-bcaa-4393-b693-93fd83407aa2 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-vif-unplugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a5d038ea-d71a-4331-8539-df72066421a1 req-d8d95f68-bcaa-4393-b693-93fd83407aa2 service nova] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a5d038ea-d71a-4331-8539-df72066421a1 req-d8d95f68-bcaa-4393-b693-93fd83407aa2 service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a5d038ea-d71a-4331-8539-df72066421a1 req-d8d95f68-bcaa-4393-b693-93fd83407aa2 service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-a5d038ea-d71a-4331-8539-df72066421a1 req-d8d95f68-bcaa-4393-b693-93fd83407aa2 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] No waiting events found dispatching network-vif-unplugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-a5d038ea-d71a-4331-8539-df72066421a1 req-d8d95f68-bcaa-4393-b693-93fd83407aa2 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-vif-unplugged-8e23be71-643c-4893-ad6f-188af8faa2eb for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5831896-d3be-4223-966e-1857ae81d693 req-44e14f97-1c2b-4ec5-a40f-203445798cbe service nova] Releasing lock "refresh_cache-bccac10d-9eaa-4371-9db9-5da725b0f5b4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:34:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Instance destroyed successfully.
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lazy-loading 'resources' on Instance uuid bccac10d-9eaa-4371-9db9-5da725b0f5b4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1914354331',display_name='tempest-TestVolumeBootPattern-server-1914354331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1914354331',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf6hPuqDO4sYOfZ2lWu9LDP5wW8qimiVDA12jeflpSIY2UShb7e3tbG241WrGBo5bQguCzcYP6bk36L+1mnZmoZWpG05HnXIsj00OHL38FAZQS0nJaPxsz5W8lwiC22Qg==',key_name='tempest-TestVolumeBootPattern-2099655517',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:30:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1236f7da218a484e86a7c25626b2e178',ramdisk_id='',reservation_id='r-rysobh5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1172028538',owner_user_name='tempest-TestVolumeBootPattern-1172028538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:30:09Z,user_data=None,user_id='b8ab71a5471a4bbcb7845d1293849449',uuid=bccac10d-9eaa-4371-9db9-5da725b0f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converting VIF {"id": "8e23be71-643c-4893-ad6f-188af8faa2eb", "address": "fa:16:3e:d3:7a:4f", "network": {"id": "3ce9adf5-5bc9-4094-90a2-2a611c114653", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-493473934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1236f7da218a484e86a7c25626b2e178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23be71-64", "ovs_interfaceid": "8e23be71-643c-4893-ad6f-188af8faa2eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_vif [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e23be71-64, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:34:56 user nova-compute[73091]: INFO os_vif [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=8e23be71-643c-4893-ad6f-188af8faa2eb,network=Network(3ce9adf5-5bc9-4094-90a2-2a611c114653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23be71-64')
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnagpQuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:34:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea8b69-f945-4f03-8e00-f4937a165f10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05128d-a003-4cbf-a6ac-af4ff576147a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:34:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d (non-flash)
Aug 16 15:34:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c579fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5494d5a-558f-4501-8eab-0a0d476f3bed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74ba30-bf57-4d26-a3a8-5349a7f20a73]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0c9dda-4afd-41d0-956b-b966925691d1]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3831976-d416-4075-9f2a-5c38b6f09020]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b722aed5-0ff4-4384-b07e-a29c19ea7df0]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ced8c-4f74-48ad-b4f9-d6d57d8fd5d0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260]
Aug 16 15:34:56 user nova-compute[73091]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d, portal: 172.16.0.220,3260] successful.
Aug 16 15:34:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff9f266-ca57-4cf8-aa60-068b607d151d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[11840cfd-44d2-4c91-8f12-1416afa50e90]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] <== disconnect_volume: return (255ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:34:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Deleting instance files /opt/stack/data/nova/instances/bccac10d-9eaa-4371-9db9-5da725b0f5b4_del
Aug 16 15:34:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Deletion of /opt/stack/data/nova/instances/bccac10d-9eaa-4371-9db9-5da725b0f5b4_del complete
Aug 16 15:34:56 user nova-compute[73091]: INFO nova.compute.manager [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 15:34:56 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:34:56 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:34:57 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:34:57 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Took 0.56 seconds to deallocate network for instance.
Aug 16 15:34:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-7ccf7b2d-a523-4d2f-af4e-63cd45005bd9 req-b669cc2a-303d-42dc-b397-8a0dd154d2d7 service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-vif-deleted-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-c32d4752-0393-43ed-858c-abf32d8c987b req-a53dd892-c4fa-481c-9a49-a0671e52bb5a service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received event network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c32d4752-0393-43ed-858c-abf32d8c987b req-a53dd892-c4fa-481c-9a49-a0671e52bb5a service nova] Acquiring lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c32d4752-0393-43ed-858c-abf32d8c987b req-a53dd892-c4fa-481c-9a49-a0671e52bb5a service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c32d4752-0393-43ed-858c-abf32d8c987b req-a53dd892-c4fa-481c-9a49-a0671e52bb5a service nova] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-c32d4752-0393-43ed-858c-abf32d8c987b req-a53dd892-c4fa-481c-9a49-a0671e52bb5a service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] No waiting events found dispatching network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:34:58 user nova-compute[73091]: WARNING nova.compute.manager [req-c32d4752-0393-43ed-858c-abf32d8c987b req-a53dd892-c4fa-481c-9a49-a0671e52bb5a service nova] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Received unexpected event network-vif-plugged-8e23be71-643c-4893-ad6f-188af8faa2eb for instance with vm_state active and task_state deleting.
Aug 16 15:34:58 user nova-compute[73091]: INFO nova.compute.manager [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Took 0.80 seconds to detach 1 volumes for instance.
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:34:58 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Deleted allocations for instance bccac10d-9eaa-4371-9db9-5da725b0f5b4
Aug 16 15:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e01-8cf2-429f-add4-760968dd3941 tempest-TestVolumeBootPattern-1172028538 tempest-TestVolumeBootPattern-1172028538-project-member] Lock "bccac10d-9eaa-4371-9db9-5da725b0f5b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.866s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:35:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:11 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200096.5782208, bccac10d-9eaa-4371-9db9-5da725b0f5b4 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:35:11 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] VM Stopped (Lifecycle Event)
Aug 16 15:35:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-96c33d03-1d89-46cc-b3f9-5f85aee28581 None None] [instance: bccac10d-9eaa-4371-9db9-5da725b0f5b4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:35:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:19 user nova-compute[73091]: INFO nova.compute.manager [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Terminating instance
Aug 16 15:35:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-266bf5c9-eeb4-42c6-984e-69fd1f2db3ff req-7feef2e7-6ed7-493f-8836-04653d07227a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-vif-unplugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-266bf5c9-eeb4-42c6-984e-69fd1f2db3ff req-7feef2e7-6ed7-493f-8836-04653d07227a service nova] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-266bf5c9-eeb4-42c6-984e-69fd1f2db3ff req-7feef2e7-6ed7-493f-8836-04653d07227a service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-266bf5c9-eeb4-42c6-984e-69fd1f2db3ff req-7feef2e7-6ed7-493f-8836-04653d07227a service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-266bf5c9-eeb4-42c6-984e-69fd1f2db3ff req-7feef2e7-6ed7-493f-8836-04653d07227a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] No waiting events found dispatching network-vif-unplugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:35:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-266bf5c9-eeb4-42c6-984e-69fd1f2db3ff req-7feef2e7-6ed7-493f-8836-04653d07227a service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-vif-unplugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:35:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Instance destroyed successfully.
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'resources' on Instance uuid 154458da-2fd8-424f-9a2c-e253bc342379 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:29:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-667200703',display_name='tempest-AttachVolumeNegativeTest-server-667200703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-667200703',id=44,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbKE1B3BH6N9QGtYienQGSiXOsYThgs6EUgxu+wQaBRgFu8edWrJzzhqZjRNI9L4W0baa+Bm+40UMRFPta0nYBGmLa8pXPlTl1ItXjAJybeQejN1OMlVvHVjg8Ve8RiNA==',key_name='tempest-keypair-1714077594',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:29:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-n7lrksyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=154458da-2fd8-424f-9a2c-e253bc342379,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "address": "fa:16:3e:52:9d:62", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4474ae2a-6c", "ovs_interfaceid": "4474ae2a-6c21-4bba-9d69-4f8d18ace014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG os_vif [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4474ae2a-6c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:20 user nova-compute[73091]: INFO os_vif [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:9d:62,bridge_name='br-int',has_traffic_filtering=True,id=4474ae2a-6c21-4bba-9d69-4f8d18ace014,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4474ae2a-6c')
Aug 16 15:35:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Deleting instance files /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379_del
Aug 16 15:35:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Deletion of /opt/stack/data/nova/instances/154458da-2fd8-424f-9a2c-e253bc342379_del complete
Aug 16 15:35:20 user nova-compute[73091]: INFO nova.compute.manager [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 15:35:20 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:35:20 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Took 0.75 seconds to deallocate network for instance.
Aug 16 15:35:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:21 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Deleted allocations for instance 154458da-2fd8-424f-9a2c-e253bc342379
Aug 16 15:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a8c0e0a-98ce-4911-962f-a0a822a06d67 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "154458da-2fd8-424f-9a2c-e253bc342379" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] Acquiring lock "154458da-2fd8-424f-9a2c-e253bc342379-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] Lock "154458da-2fd8-424f-9a2c-e253bc342379-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] No waiting events found dispatching network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:35:21 user nova-compute[73091]: WARNING nova.compute.manager [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received unexpected event network-vif-plugged-4474ae2a-6c21-4bba-9d69-4f8d18ace014 for instance with vm_state deleted and task_state None.
Aug 16 15:35:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-41bcea3a-5199-43ad-a3b0-b7c2c5547778 req-b5a173b8-a1b5-46cb-b78b-edf5dcde72d3 service nova] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Received event network-vif-deleted-4474ae2a-6c21-4bba-9d69-4f8d18ace014 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:35:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200120.0188012, 154458da-2fd8-424f-9a2c-e253bc342379 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:35:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] VM Stopped (Lifecycle Event)
Aug 16 15:35:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:35:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=25.290088653564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-236d9bd2-2746-479f-b471-58e6edbadcaa None None] [instance: 154458da-2fd8-424f-9a2c-e253bc342379] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b06a376b-edd0-4f06-933b-c4a6de4ce394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:35:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Verify base images {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Image id b18d278d-2e25-4ef6-ba90-d1af21f699be yields fingerprint d8e952ce1c353ed9eab9b871a33d1969d35e882a {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] image b18d278d-2e25-4ef6-ba90-d1af21f699be at (/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a): checking
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] image b18d278d-2e25-4ef6-ba90-d1af21f699be at (/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a): image is in use {{(pid=73091) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] b06a376b-edd0-4f06-933b-c4a6de4ce394 is a valid instance name {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] b06a376b-edd0-4f06-933b-c4a6de4ce394 has a disk file {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b06a376b-edd0-4f06-933b-c4a6de4ce394 is backed by d8e952ce1c353ed9eab9b871a33d1969d35e882a {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9
Aug 16 15:35:54 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Active base files: /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Removable base files: /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3 /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524 /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070 /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160 /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9 /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca7034b8c3b26b53b5cd0eece37035f8872f97d3
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/224129cbf7e47ebf45cbf615ee2e6f4a706cb524
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/58d19f9dbb9735e4fe6f8c6f54f3e9f67af7ee0b
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1bac8b89082aa8d532438b1c204010332955878b
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af36b13246a2ed571292a301dac09b8cf761601f
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ea14486199119386dd75b8f17c522eba52d3070
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4acdf1b2f7d5e8db5670a1db81da0228f242c160
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/84a9b24521a60880473d92ec8ef9625fbe08ece9
Aug 16 15:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3033bb9daf0460f21cfbc882875b4aa82d561093
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Verification complete {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Verify swap images {{(pid=73091) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 15:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Verify ephemeral images {{(pid=73091) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 15:35:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:35:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:35:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:07 user nova-compute[73091]: INFO nova.compute.manager [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Terminating instance
Aug 16 15:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a7f4030-6ed6-4ea9-b164-d2d1b64972b4 req-60f61868-3e85-47bb-a69c-82f757b3360d service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-vif-unplugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a7f4030-6ed6-4ea9-b164-d2d1b64972b4 req-60f61868-3e85-47bb-a69c-82f757b3360d service nova] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a7f4030-6ed6-4ea9-b164-d2d1b64972b4 req-60f61868-3e85-47bb-a69c-82f757b3360d service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a7f4030-6ed6-4ea9-b164-d2d1b64972b4 req-60f61868-3e85-47bb-a69c-82f757b3360d service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a7f4030-6ed6-4ea9-b164-d2d1b64972b4 req-60f61868-3e85-47bb-a69c-82f757b3360d service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] No waiting events found dispatching network-vif-unplugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a7f4030-6ed6-4ea9-b164-d2d1b64972b4 req-60f61868-3e85-47bb-a69c-82f757b3360d service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-vif-unplugged-fdb94544-9cc1-43a7-afef-be719da19183 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:36:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Instance destroyed successfully.
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lazy-loading 'resources' on Instance uuid b06a376b-edd0-4f06-933b-c4a6de4ce394 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-154288541',display_name='tempest-VolumesActionsTest-instance-154288541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-154288541',id=48,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:34:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='737d18f962a84f8e86a7a7f58ec649b1',ramdisk_id='',reservation_id='r-r0r4snag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-731337952',owner_user_name='tempest-VolumesActionsTest-731337952-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:34:13Z,user_data=None,user_id='2b66d0459bf44f1e841c50ad6306f9a7',uuid=b06a376b-edd0-4f06-933b-c4a6de4ce394,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Converting VIF {"id": "fdb94544-9cc1-43a7-afef-be719da19183", "address": "fa:16:3e:9a:0b:0d", "network": {"id": "fa96aeff-a910-40cf-9b23-f35eeb8d3a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733468599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737d18f962a84f8e86a7a7f58ec649b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb94544-9c", "ovs_interfaceid": "fdb94544-9cc1-43a7-afef-be719da19183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG os_vif [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdb94544-9c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:36:08 user nova-compute[73091]: INFO os_vif [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=fdb94544-9cc1-43a7-afef-be719da19183,network=Network(fa96aeff-a910-40cf-9b23-f35eeb8d3a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb94544-9c')
Aug 16 15:36:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Deleting instance files /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394_del
Aug 16 15:36:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Deletion of /opt/stack/data/nova/instances/b06a376b-edd0-4f06-933b-c4a6de4ce394_del complete
Aug 16 15:36:08 user nova-compute[73091]: INFO nova.compute.manager [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 15:36:08 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:36:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:36:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Took 0.52 seconds to deallocate network for instance.
Aug 16 15:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-68678524-4404-45aa-b8b5-e0fdc788fbf5 req-747a6414-4e0c-437d-ac48-dbcd8b4d2a77 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-vif-deleted-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:09 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Deleted allocations for instance b06a376b-edd0-4f06-933b-c4a6de4ce394
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8164fc0a-8ef8-4617-8589-fbebeef0526f tempest-VolumesActionsTest-731337952 tempest-VolumesActionsTest-731337952-project-member] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.712s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-732ee270-d2af-4243-8155-d489d2ea2fe0 req-3f899157-d006-4d0a-8cbb-496acc6a8b64 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received event network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-732ee270-d2af-4243-8155-d489d2ea2fe0 req-3f899157-d006-4d0a-8cbb-496acc6a8b64 service nova] Acquiring lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-732ee270-d2af-4243-8155-d489d2ea2fe0 req-3f899157-d006-4d0a-8cbb-496acc6a8b64 service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-732ee270-d2af-4243-8155-d489d2ea2fe0 req-3f899157-d006-4d0a-8cbb-496acc6a8b64 service nova] Lock "b06a376b-edd0-4f06-933b-c4a6de4ce394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-732ee270-d2af-4243-8155-d489d2ea2fe0 req-3f899157-d006-4d0a-8cbb-496acc6a8b64 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] No waiting events found dispatching network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:36:09 user nova-compute[73091]: WARNING nova.compute.manager [req-732ee270-d2af-4243-8155-d489d2ea2fe0 req-3f899157-d006-4d0a-8cbb-496acc6a8b64 service nova] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Received unexpected event network-vif-plugged-fdb94544-9cc1-43a7-afef-be719da19183 for instance with vm_state deleted and task_state None.
Aug 16 15:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:36:13 user nova-compute[73091]: INFO nova.compute.claims [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Claim successful on node user
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:36:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:36:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Creating image(s)
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "/opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG nova.policy [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '043ba186a9b4416c903393c25a4a87d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62db39d6754641d89841f031b210383b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk 1073741824" returned: 0 in 0.091s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Successfully created port: fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Cannot resize image /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'migration_context' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Ensure instance console log exists: /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Successfully updated port: fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquired lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-changed-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Refreshing instance network info cache due to event network-changed-fa48ef15-162f-46af-ba20-8a0986735553. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] Acquiring lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Releasing lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Instance network_info: |[{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] Acquired lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Refreshing network info cache for port fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Start _get_guest_xml network_info=[{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:36:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:36:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1017001444',display_name='tempest-AttachVolumeNegativeTest-server-1017001444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1017001444',id=49,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZYR0kzjCMYp/C/5ba+DOkQnsJjf19WOY5Llgvykl49hlk8pPPYkHO1OvlIY/k7l5MtI6mRA1D4OBMJymCRo/9acklazEey4KZ1MHXx8m71vnOkgcNpcVMNXjeXJEBjtw==',key_name='tempest-keypair-1067729249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-e550hjdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=868f71d6-f333-46ca-8882-bd6a02069590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'pci_devices' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:36:16 user nova-compute[73091]:   <uuid>868f71d6-f333-46ca-8882-bd6a02069590</uuid>
Aug 16 15:36:16 user nova-compute[73091]:   <name>instance-00000031</name>
Aug 16 15:36:16 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:36:16 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:36:16 user nova-compute[73091]:   <metadata>
Aug 16 15:36:16 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:36:16 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:36:16 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1017001444</nova:name>
Aug 16 15:36:16 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:36:16</nova:creationTime>
Aug 16 15:36:16 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:36:16 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:36:16 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:36:16 user nova-compute[73091]:       <nova:owner>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:user uuid="043ba186a9b4416c903393c25a4a87d6">tempest-AttachVolumeNegativeTest-2024154116-project-member</nova:user>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:project uuid="62db39d6754641d89841f031b210383b">tempest-AttachVolumeNegativeTest-2024154116</nova:project>
Aug 16 15:36:16 user nova-compute[73091]:       </nova:owner>
Aug 16 15:36:16 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:36:16 user nova-compute[73091]:       <nova:ports>
Aug 16 15:36:16 user nova-compute[73091]:         <nova:port uuid="fa48ef15-162f-46af-ba20-8a0986735553">
Aug 16 15:36:16 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 15:36:16 user nova-compute[73091]:         </nova:port>
Aug 16 15:36:16 user nova-compute[73091]:       </nova:ports>
Aug 16 15:36:16 user nova-compute[73091]:     </nova:instance>
Aug 16 15:36:16 user nova-compute[73091]:   </metadata>
Aug 16 15:36:16 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:36:16 user nova-compute[73091]:     <system>
Aug 16 15:36:16 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:36:16 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:36:16 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:36:16 user nova-compute[73091]:       <entry name="serial">868f71d6-f333-46ca-8882-bd6a02069590</entry>
Aug 16 15:36:16 user nova-compute[73091]:       <entry name="uuid">868f71d6-f333-46ca-8882-bd6a02069590</entry>
Aug 16 15:36:16 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:36:16 user nova-compute[73091]:     </system>
Aug 16 15:36:16 user nova-compute[73091]:   </sysinfo>
Aug 16 15:36:16 user nova-compute[73091]:   <os>
Aug 16 15:36:16 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:36:16 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:36:16 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:36:16 user nova-compute[73091]:   </os>
Aug 16 15:36:16 user nova-compute[73091]:   <features>
Aug 16 15:36:16 user nova-compute[73091]:     <acpi/>
Aug 16 15:36:16 user nova-compute[73091]:     <apic/>
Aug 16 15:36:16 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:36:16 user nova-compute[73091]:   </features>
Aug 16 15:36:16 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:36:16 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:36:16 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:36:16 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:36:16 user nova-compute[73091]:   </clock>
Aug 16 15:36:16 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:36:16 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:36:16 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:36:16 user nova-compute[73091]:   </cpu>
Aug 16 15:36:16 user nova-compute[73091]:   <devices>
Aug 16 15:36:16 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:36:16 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:36:16 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk"/>
Aug 16 15:36:16 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:36:16 user nova-compute[73091]:     </disk>
Aug 16 15:36:16 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:36:16 user nova-compute[73091]:       <mac address="fa:16:3e:d7:74:0f"/>
Aug 16 15:36:16 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:36:16 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:36:16 user nova-compute[73091]:       <target dev="tapfa48ef15-16"/>
Aug 16 15:36:16 user nova-compute[73091]:     </interface>
Aug 16 15:36:16 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:36:16 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/console.log" append="off"/>
Aug 16 15:36:16 user nova-compute[73091]:     </serial>
Aug 16 15:36:16 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:36:16 user nova-compute[73091]:     <video>
Aug 16 15:36:16 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:36:16 user nova-compute[73091]:     </video>
Aug 16 15:36:16 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:36:16 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:36:16 user nova-compute[73091]:     </rng>
Aug 16 15:36:16 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:36:16 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:36:16 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:36:16 user nova-compute[73091]:     </memballoon>
Aug 16 15:36:16 user nova-compute[73091]:   </devices>
Aug 16 15:36:16 user nova-compute[73091]: </domain>
Aug 16 15:36:16 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1017001444',display_name='tempest-AttachVolumeNegativeTest-server-1017001444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1017001444',id=49,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZYR0kzjCMYp/C/5ba+DOkQnsJjf19WOY5Llgvykl49hlk8pPPYkHO1OvlIY/k7l5MtI6mRA1D4OBMJymCRo/9acklazEey4KZ1MHXx8m71vnOkgcNpcVMNXjeXJEBjtw==',key_name='tempest-keypair-1067729249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-e550hjdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=868f71d6-f333-46ca-8882-bd6a02069590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG os_vif [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa48ef15-16, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa48ef15-16, col_values=(('external_ids', {'iface-id': 'fa48ef15-162f-46af-ba20-8a0986735553', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:74:0f', 'vm-uuid': '868f71d6-f333-46ca-8882-bd6a02069590'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:16 user nova-compute[73091]: INFO os_vif [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16')
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:d7:74:0f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:36:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updated VIF entry in instance network info cache for port fa48ef15-162f-46af-ba20-8a0986735553. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:36:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a96d101-9d1e-4a1c-ba53-351cd98a0b0f req-d89a3926-3535-4191-8300-f3f4aa785a51 service nova] Releasing lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-05080ce9-de09-4f3f-a969-0c9eafc51dba req-3eb831ca-e690-4674-b706-3f0b3576a738 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05080ce9-de09-4f3f-a969-0c9eafc51dba req-3eb831ca-e690-4674-b706-3f0b3576a738 service nova] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05080ce9-de09-4f3f-a969-0c9eafc51dba req-3eb831ca-e690-4674-b706-3f0b3576a738 service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05080ce9-de09-4f3f-a969-0c9eafc51dba req-3eb831ca-e690-4674-b706-3f0b3576a738 service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-05080ce9-de09-4f3f-a969-0c9eafc51dba req-3eb831ca-e690-4674-b706-3f0b3576a738 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] No waiting events found dispatching network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:36:18 user nova-compute[73091]: WARNING nova.compute.manager [req-05080ce9-de09-4f3f-a969-0c9eafc51dba req-3eb831ca-e690-4674-b706-3f0b3576a738 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received unexpected event network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 for instance with vm_state building and task_state spawning.
Aug 16 15:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200180.402231, 868f71d6-f333-46ca-8882-bd6a02069590 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] VM Resumed (Lifecycle Event)
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Instance spawned successfully.
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200180.4056737, 868f71d6-f333-46ca-8882-bd6a02069590 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] VM Started (Lifecycle Event)
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:36:20 user nova-compute[73091]: INFO nova.compute.manager [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Took 6.71 seconds to build instance.
Aug 16 15:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0dbb20c6-8504-4809-9857-7c68bdde94cf tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-aeb7d88a-3f21-4d02-b477-e3f7f9612e12 req-5a76caf7-c34c-479f-ad68-30b7f885944b service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aeb7d88a-3f21-4d02-b477-e3f7f9612e12 req-5a76caf7-c34c-479f-ad68-30b7f885944b service nova] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aeb7d88a-3f21-4d02-b477-e3f7f9612e12 req-5a76caf7-c34c-479f-ad68-30b7f885944b service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aeb7d88a-3f21-4d02-b477-e3f7f9612e12 req-5a76caf7-c34c-479f-ad68-30b7f885944b service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-aeb7d88a-3f21-4d02-b477-e3f7f9612e12 req-5a76caf7-c34c-479f-ad68-30b7f885944b service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] No waiting events found dispatching network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:36:20 user nova-compute[73091]: WARNING nova.compute.manager [req-aeb7d88a-3f21-4d02-b477-e3f7f9612e12 req-5a76caf7-c34c-479f-ad68-30b7f885944b service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received unexpected event network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 for instance with vm_state active and task_state None.
Aug 16 15:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:23 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200168.3642697, b06a376b-edd0-4f06-933b-c4a6de4ce394 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:36:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] VM Stopped (Lifecycle Event)
Aug 16 15:36:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-98f8e381-6807-488d-919b-c5df85fb0ca7 None None] [instance: b06a376b-edd0-4f06-933b-c4a6de4ce394] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:36:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:36:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:36:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=25.28110122680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 868f71d6-f333-46ca-8882-bd6a02069590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:36:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:36:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:36:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:36:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:36:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:36:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:36:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:36:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:37:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "868f71d6-f333-46ca-8882-bd6a02069590" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "868f71d6-f333-46ca-8882-bd6a02069590" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:37:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:37:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:37:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.278064727783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 868f71d6-f333-46ca-8882-bd6a02069590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:37:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:37:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:37:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:37:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:37:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:37:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:37:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:37:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:37:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-changed-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:38:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Refreshing instance network info cache due to event network-changed-fa48ef15-162f-46af-ba20-8a0986735553. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:38:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] Acquiring lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:38:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] Acquired lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:38:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Refreshing network info cache for port fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:38:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updated VIF entry in instance network info cache for port fa48ef15-162f-46af-ba20-8a0986735553. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:38:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:38:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f1474544-bac0-4494-ad31-e89a395895bd req-9225bfa4-1cd6-4cc6-8dc0-ad1198c62469 service nova] Releasing lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:38:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:38:08 user nova-compute[73091]: INFO nova.compute.manager [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Attaching volume c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 to /dev/vdb
Aug 16 15:38:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdbb8f3-b7fe-47f8-9bed-da06707c78fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9823f7d-f6b0-4114-a3b1-0e9744bc907b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea244333-4e5b-4c5d-86b4-3a1452739ee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1609392c-42c1-4b33-8526-e6a7f8f7646e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:38:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:38:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa16634-e11d-455b-a5a4-d481a050bf79]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:38:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating existing volume attachment record: 21b07a38-d371-4a3d-88a8-807e40e430fe {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:38:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiaVnwsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:38:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:38:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:38:18 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68361da9-6945-4a0a-8845-4a669e555d70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:38:18 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[876a61dd-cfce-4431-98f4-d7154d07b5ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466] added
Aug 16 15:38:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5297c2e1-cc02-4a5f-b89f-64453bbbb467]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343a59e-25a8-4239-8c5e-8b78035cf498]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiaVnwsJ {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiaVnwsJ" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f5d3b-8790-454b-9e1b-b5a4a0c5ff66]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiaVnwsJ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a4e6f-18b3-4fc2-b3d7-a2f38efe96c2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ab581f-3626-4fdd-bf8d-f661aa8142d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:38:19 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:38:19 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:38:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:38:19 user nova-compute[73091]: 
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7bb86-2cbc-4b55-8688-741f03d4618a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260]
Aug 16 15:38:19 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260] successful.
Aug 16 15:38:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e150057-2d81-4164-8023-63e9314d4ac8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41f5466-431f-47f3-8ff6-4c35402a8f4f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 (non-flash)
Aug 16 15:38:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 (non-flash)
Aug 16 15:38:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8e007-1eda-40cd-a186-fbac11ab20a3]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiaVnwsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23961313239383739', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961313239383739', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:38:20 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:38:20 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:38:20 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:38:20 user nova-compute[73091]:   <serial>c35d5ab6-ca1e-4fc3-b2c4-29832dd90466</serial>
Aug 16 15:38:20 user nova-compute[73091]: </disk>
Aug 16 15:38:20 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:d7:74:0f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:38:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-959d1eb5-b55e-4246-b48a-04e4f6241473 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.176s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:38:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:38:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:38:21 user nova-compute[73091]: INFO nova.compute.manager [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Detaching volume c35d5ab6-ca1e-4fc3-b2c4-29832dd90466
Aug 16 15:38:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:38:21 user nova-compute[73091]: INFO nova.virt.block_device [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Attempting to driver detach volume c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 from mountpoint /dev/vdb
Aug 16 15:38:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Attempting to detach device vdb from instance 868f71d6-f333-46ca-8882-bd6a02069590 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:38:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:38:21 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:38:21 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:38:21 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:38:21 user nova-compute[73091]:   <serial>c35d5ab6-ca1e-4fc3-b2c4-29832dd90466</serial>
Aug 16 15:38:21 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:38:21 user nova-compute[73091]: </disk>
Aug 16 15:38:21 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:38:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully detached device vdb from instance 868f71d6-f333-46ca-8882-bd6a02069590 from the persistent domain config.
Aug 16 15:38:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 868f71d6-f333-46ca-8882-bd6a02069590 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:38:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:38:21 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:38:21 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:38:21 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:38:21 user nova-compute[73091]:   <serial>c35d5ab6-ca1e-4fc3-b2c4-29832dd90466</serial>
Aug 16 15:38:21 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:38:21 user nova-compute[73091]: </disk>
Aug 16 15:38:21 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692200302.3561263, 868f71d6-f333-46ca-8882-bd6a02069590 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:38:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully detached device vdb from instance 868f71d6-f333-46ca-8882-bd6a02069590 from the live domain config.
Aug 16 15:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiaVnwsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:38:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc804f2-79d6-49d9-8dff-43357d3be5ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80349af5-60ad-4e97-b44b-53547576a870]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 (non-flash)
Aug 16 15:38:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 (non-flash)
Aug 16 15:38:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f114c3aa560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948f4f5-45a1-4234-aef2-39fea3c5e4d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3264ba6-2b7c-421e-b038-a077c5667b1d]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ba159-9ea0-455c-9029-64ab08032f35]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be31973a-9603-4713-b50c-a2263621eae9]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb292a9-2798-4135-b62c-262d70843589]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf89ceee-505e-4ec0-ac43-5ce5f4ce6778]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260]
Aug 16 15:38:22 user nova-compute[73091]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466, portal: 172.16.0.220,3260] successful.
Aug 16 15:38:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35d5ab6-ca1e-4fc3-b2c4-29832dd90466 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1ef690-9c42-43fe-b06e-d3b9bf737929]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== disconnect_volume: return (261ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:38:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:38:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e1da4b5-24a0-46ff-933a-01444b10395c tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:38:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:38:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [{"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-868f71d6-f333-46ca-8882-bd6a02069590" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:38:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:38:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:38:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.275707244873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 868f71d6-f333-46ca-8882-bd6a02069590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:38:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:38:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:38:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:38:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:38:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:39:08 user nova-compute[73091]: INFO nova.compute.claims [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Claim successful on node user
Aug 16 15:39:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:39:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.policy [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10201a1ac71e40389eac6a82faa44aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3aaf6f56641839b51462f9cc2a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:39:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Creating image(s)
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "/opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "/opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "/opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Successfully created port: 4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Cannot resize image /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'migration_context' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Ensure instance console log exists: /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Successfully updated port: 4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquired lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-changed-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Refreshing instance network info cache due to event network-changed-4a92568f-3a86-41b1-ae2a-dfd41a5128f0. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] Acquiring lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Releasing lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Instance network_info: |[{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] Acquired lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Refreshing network info cache for port 4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Start _get_guest_xml network_info=[{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:39:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:39:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-530137032',display_name='tempest-TestServerVolumeAttachmentScenario-server-530137032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-530137032',id=50,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb5WljC5Sh87zOwB2DMJ1P1UH0lYLr4lEGXX02XAH1R47dcgmwWWMyVnPTYDKWCBw4C9oDicRURVzR8JORn5YMaJGDWyEcj2JZ4GrDFROENjpjEBoUX6rusifvFH7Q8kg==',key_name='tempest-keypair-563236393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a3aaf6f56641839b51462f9cc2a16d',ramdisk_id='',reservation_id='r-rravy7ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-809955122',owner_user_name='tempest-TestServerVolumeAttachmentScenario-809955122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10201a1ac71e40389eac6a82faa44aa7',uuid=64053a48-46ff-493b-9356-ae1316e760a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Converting VIF {"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'pci_devices' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:39:10 user nova-compute[73091]:   <uuid>64053a48-46ff-493b-9356-ae1316e760a5</uuid>
Aug 16 15:39:10 user nova-compute[73091]:   <name>instance-00000032</name>
Aug 16 15:39:10 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:39:10 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:39:10 user nova-compute[73091]:   <metadata>
Aug 16 15:39:10 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:39:10 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:39:10 user nova-compute[73091]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-530137032</nova:name>
Aug 16 15:39:10 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:39:10</nova:creationTime>
Aug 16 15:39:10 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:39:10 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:39:10 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:39:10 user nova-compute[73091]:       <nova:owner>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:user uuid="10201a1ac71e40389eac6a82faa44aa7">tempest-TestServerVolumeAttachmentScenario-809955122-project-member</nova:user>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:project uuid="19a3aaf6f56641839b51462f9cc2a16d">tempest-TestServerVolumeAttachmentScenario-809955122</nova:project>
Aug 16 15:39:10 user nova-compute[73091]:       </nova:owner>
Aug 16 15:39:10 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:39:10 user nova-compute[73091]:       <nova:ports>
Aug 16 15:39:10 user nova-compute[73091]:         <nova:port uuid="4a92568f-3a86-41b1-ae2a-dfd41a5128f0">
Aug 16 15:39:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 15:39:10 user nova-compute[73091]:         </nova:port>
Aug 16 15:39:10 user nova-compute[73091]:       </nova:ports>
Aug 16 15:39:10 user nova-compute[73091]:     </nova:instance>
Aug 16 15:39:10 user nova-compute[73091]:   </metadata>
Aug 16 15:39:10 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:39:10 user nova-compute[73091]:     <system>
Aug 16 15:39:10 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:39:10 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:39:10 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:39:10 user nova-compute[73091]:       <entry name="serial">64053a48-46ff-493b-9356-ae1316e760a5</entry>
Aug 16 15:39:10 user nova-compute[73091]:       <entry name="uuid">64053a48-46ff-493b-9356-ae1316e760a5</entry>
Aug 16 15:39:10 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:39:10 user nova-compute[73091]:     </system>
Aug 16 15:39:10 user nova-compute[73091]:   </sysinfo>
Aug 16 15:39:10 user nova-compute[73091]:   <os>
Aug 16 15:39:10 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:39:10 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:39:10 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:39:10 user nova-compute[73091]:   </os>
Aug 16 15:39:10 user nova-compute[73091]:   <features>
Aug 16 15:39:10 user nova-compute[73091]:     <acpi/>
Aug 16 15:39:10 user nova-compute[73091]:     <apic/>
Aug 16 15:39:10 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:39:10 user nova-compute[73091]:   </features>
Aug 16 15:39:10 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:39:10 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:39:10 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:39:10 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:39:10 user nova-compute[73091]:   </clock>
Aug 16 15:39:10 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:39:10 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:39:10 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:39:10 user nova-compute[73091]:   </cpu>
Aug 16 15:39:10 user nova-compute[73091]:   <devices>
Aug 16 15:39:10 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:39:10 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:39:10 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk"/>
Aug 16 15:39:10 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:39:10 user nova-compute[73091]:     </disk>
Aug 16 15:39:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:39:10 user nova-compute[73091]:       <mac address="fa:16:3e:bb:5b:3d"/>
Aug 16 15:39:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:39:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:39:10 user nova-compute[73091]:       <target dev="tap4a92568f-3a"/>
Aug 16 15:39:10 user nova-compute[73091]:     </interface>
Aug 16 15:39:10 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:39:10 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/console.log" append="off"/>
Aug 16 15:39:10 user nova-compute[73091]:     </serial>
Aug 16 15:39:10 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:39:10 user nova-compute[73091]:     <video>
Aug 16 15:39:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:39:10 user nova-compute[73091]:     </video>
Aug 16 15:39:10 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:39:10 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:39:10 user nova-compute[73091]:     </rng>
Aug 16 15:39:10 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:39:10 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:39:10 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:39:10 user nova-compute[73091]:     </memballoon>
Aug 16 15:39:10 user nova-compute[73091]:   </devices>
Aug 16 15:39:10 user nova-compute[73091]: </domain>
Aug 16 15:39:10 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-530137032',display_name='tempest-TestServerVolumeAttachmentScenario-server-530137032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-530137032',id=50,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb5WljC5Sh87zOwB2DMJ1P1UH0lYLr4lEGXX02XAH1R47dcgmwWWMyVnPTYDKWCBw4C9oDicRURVzR8JORn5YMaJGDWyEcj2JZ4GrDFROENjpjEBoUX6rusifvFH7Q8kg==',key_name='tempest-keypair-563236393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a3aaf6f56641839b51462f9cc2a16d',ramdisk_id='',reservation_id='r-rravy7ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-809955122',owner_user_name='tempest-TestServerVolumeAttachmentScenario-809955122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10201a1ac71e40389eac6a82faa44aa7',uuid=64053a48-46ff-493b-9356-ae1316e760a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Converting VIF {"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG os_vif [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a92568f-3a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a92568f-3a, col_values=(('external_ids', {'iface-id': '4a92568f-3a86-41b1-ae2a-dfd41a5128f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:5b:3d', 'vm-uuid': '64053a48-46ff-493b-9356-ae1316e760a5'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:10 user nova-compute[73091]: INFO os_vif [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a')
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:39:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No VIF found with MAC fa:16:3e:bb:5b:3d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:39:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updated VIF entry in instance network info cache for port 4a92568f-3a86-41b1-ae2a-dfd41a5128f0. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:39:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:39:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af7a73a3-6d2a-4637-994f-e413cd53a47e req-3528f998-dc81-408f-8a9c-3360e3760253 service nova] Releasing lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:12 user nova-compute[73091]: INFO nova.compute.manager [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Terminating instance
Aug 16 15:39:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-48f98fbb-12aa-4f45-8b68-d76087a6b258 req-d3a11d1e-b1d1-4d6a-a564-67528f29d463 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48f98fbb-12aa-4f45-8b68-d76087a6b258 req-d3a11d1e-b1d1-4d6a-a564-67528f29d463 service nova] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48f98fbb-12aa-4f45-8b68-d76087a6b258 req-d3a11d1e-b1d1-4d6a-a564-67528f29d463 service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48f98fbb-12aa-4f45-8b68-d76087a6b258 req-d3a11d1e-b1d1-4d6a-a564-67528f29d463 service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-48f98fbb-12aa-4f45-8b68-d76087a6b258 req-d3a11d1e-b1d1-4d6a-a564-67528f29d463 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] No waiting events found dispatching network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:39:12 user nova-compute[73091]: WARNING nova.compute.manager [req-48f98fbb-12aa-4f45-8b68-d76087a6b258 req-d3a11d1e-b1d1-4d6a-a564-67528f29d463 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received unexpected event network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 for instance with vm_state building and task_state spawning.
Aug 16 15:39:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-b9ac6b67-ec10-4e57-b9dd-4615e64050ca req-cc07d19c-99ae-4bcc-815a-d48369651581 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-vif-unplugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b9ac6b67-ec10-4e57-b9dd-4615e64050ca req-cc07d19c-99ae-4bcc-815a-d48369651581 service nova] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b9ac6b67-ec10-4e57-b9dd-4615e64050ca req-cc07d19c-99ae-4bcc-815a-d48369651581 service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b9ac6b67-ec10-4e57-b9dd-4615e64050ca req-cc07d19c-99ae-4bcc-815a-d48369651581 service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-b9ac6b67-ec10-4e57-b9dd-4615e64050ca req-cc07d19c-99ae-4bcc-815a-d48369651581 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] No waiting events found dispatching network-vif-unplugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:39:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-b9ac6b67-ec10-4e57-b9dd-4615e64050ca req-cc07d19c-99ae-4bcc-815a-d48369651581 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-vif-unplugged-fa48ef15-162f-46af-ba20-8a0986735553 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:39:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Instance destroyed successfully.
Aug 16 15:39:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'resources' on Instance uuid 868f71d6-f333-46ca-8882-bd6a02069590 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1017001444',display_name='tempest-AttachVolumeNegativeTest-server-1017001444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1017001444',id=49,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZYR0kzjCMYp/C/5ba+DOkQnsJjf19WOY5Llgvykl49hlk8pPPYkHO1OvlIY/k7l5MtI6mRA1D4OBMJymCRo/9acklazEey4KZ1MHXx8m71vnOkgcNpcVMNXjeXJEBjtw==',key_name='tempest-keypair-1067729249',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-e550hjdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=868f71d6-f333-46ca-8882-bd6a02069590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "fa48ef15-162f-46af-ba20-8a0986735553", "address": "fa:16:3e:d7:74:0f", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa48ef15-16", "ovs_interfaceid": "fa48ef15-162f-46af-ba20-8a0986735553", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG os_vif [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa48ef15-16, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: INFO os_vif [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:74:0f,bridge_name='br-int',has_traffic_filtering=True,id=fa48ef15-162f-46af-ba20-8a0986735553,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa48ef15-16')
Aug 16 15:39:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Deleting instance files /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590_del
Aug 16 15:39:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Deletion of /opt/stack/data/nova/instances/868f71d6-f333-46ca-8882-bd6a02069590_del complete
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: INFO nova.compute.manager [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 15:39:13 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:39:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Took 0.99 seconds to deallocate network for instance.
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:14 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Deleted allocations for instance 868f71d6-f333-46ca-8882-bd6a02069590
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-083aa1d7-19f9-4362-be1a-af4e711d7182 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "868f71d6-f333-46ca-8882-bd6a02069590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] No waiting events found dispatching network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:39:14 user nova-compute[73091]: WARNING nova.compute.manager [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received unexpected event network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 for instance with vm_state building and task_state spawning.
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-76f0507d-9a07-454c-a0d2-457029493228 req-be4bee06-ff60-472c-bf93-ad1027794d32 service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-vif-deleted-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0fbc069-a5d5-4da0-ba4f-53d0cee7787c req-4a5443c5-dc5d-44d5-9fa6-4c022d73ca9d service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received event network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0fbc069-a5d5-4da0-ba4f-53d0cee7787c req-4a5443c5-dc5d-44d5-9fa6-4c022d73ca9d service nova] Acquiring lock "868f71d6-f333-46ca-8882-bd6a02069590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0fbc069-a5d5-4da0-ba4f-53d0cee7787c req-4a5443c5-dc5d-44d5-9fa6-4c022d73ca9d service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0fbc069-a5d5-4da0-ba4f-53d0cee7787c req-4a5443c5-dc5d-44d5-9fa6-4c022d73ca9d service nova] Lock "868f71d6-f333-46ca-8882-bd6a02069590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0fbc069-a5d5-4da0-ba4f-53d0cee7787c req-4a5443c5-dc5d-44d5-9fa6-4c022d73ca9d service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] No waiting events found dispatching network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:39:14 user nova-compute[73091]: WARNING nova.compute.manager [req-e0fbc069-a5d5-4da0-ba4f-53d0cee7787c req-4a5443c5-dc5d-44d5-9fa6-4c022d73ca9d service nova] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Received unexpected event network-vif-plugged-fa48ef15-162f-46af-ba20-8a0986735553 for instance with vm_state deleted and task_state None.
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200354.9617426, 64053a48-46ff-493b-9356-ae1316e760a5 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:39:14 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] VM Resumed (Lifecycle Event)
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:39:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Instance spawned successfully.
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:39:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:39:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:39:15 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:39:15 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200354.9661524, 64053a48-46ff-493b-9356-ae1316e760a5 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:39:15 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] VM Started (Lifecycle Event)
Aug 16 15:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:39:15 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:39:15 user nova-compute[73091]: INFO nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 16 15:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:39:15 user nova-compute[73091]: INFO nova.compute.manager [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Took 6.52 seconds to build instance.
Aug 16 15:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-906339e3-9497-4b63-a87e-de87f5f20eaa tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.658s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200352.9995658, 868f71d6-f333-46ca-8882-bd6a02069590 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:39:28 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] VM Stopped (Lifecycle Event)
Aug 16 15:39:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ce96bfd0-a664-4f20-9cee-dc5835266440 None None] [instance: 868f71d6-f333-46ca-8882-bd6a02069590] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:39:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:39:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:39:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:39:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:39:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.272907257080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 64053a48-46ff-493b-9356-ae1316e760a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:39:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:39:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:39:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:39:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:39:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:39:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:39:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:39:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:39:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:40:06 user nova-compute[73091]: INFO nova.compute.claims [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Claim successful on node user
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:40:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.policy [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '043ba186a9b4416c903393c25a4a87d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62db39d6754641d89841f031b210383b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:40:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Creating image(s)
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "/opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "/opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Cannot resize image /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'migration_context' on Instance uuid 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Ensure instance console log exists: /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Successfully created port: 50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Successfully updated port: 50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquired lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-changed-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Refreshing instance network info cache due to event network-changed-50d4d10f-b23e-4c72-9d38-e0aab324cfcb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] Acquiring lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating instance_info_cache with network_info: [{"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Releasing lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Instance network_info: |[{"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] Acquired lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Refreshing network info cache for port 50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Start _get_guest_xml network_info=[{"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:40:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:40:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1256921909',display_name='tempest-AttachVolumeNegativeTest-server-1256921909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1256921909',id=51,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5J+ZIhvtOZtKHIMYlQMHYpgLAZQvkVhmTVnrrCESnAkcvBppuhH1/6FRaeXm53Jhdz6b2Dk96nOHIZNq+jWRKhXNxEbm/GmIU0wIFMlp2qKznFjNP7evomJf0K4qc/nw==',key_name='tempest-keypair-1030540885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-w8ro76gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=93d31298-ac2f-42b7-acb4-f74d3eaf11b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'pci_devices' on Instance uuid 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:40:08 user nova-compute[73091]:   <uuid>93d31298-ac2f-42b7-acb4-f74d3eaf11b6</uuid>
Aug 16 15:40:08 user nova-compute[73091]:   <name>instance-00000033</name>
Aug 16 15:40:08 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:40:08 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:40:08 user nova-compute[73091]:   <metadata>
Aug 16 15:40:08 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:40:08 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:40:08 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1256921909</nova:name>
Aug 16 15:40:08 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:40:08</nova:creationTime>
Aug 16 15:40:08 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:40:08 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:40:08 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:40:08 user nova-compute[73091]:       <nova:owner>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:user uuid="043ba186a9b4416c903393c25a4a87d6">tempest-AttachVolumeNegativeTest-2024154116-project-member</nova:user>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:project uuid="62db39d6754641d89841f031b210383b">tempest-AttachVolumeNegativeTest-2024154116</nova:project>
Aug 16 15:40:08 user nova-compute[73091]:       </nova:owner>
Aug 16 15:40:08 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:40:08 user nova-compute[73091]:       <nova:ports>
Aug 16 15:40:08 user nova-compute[73091]:         <nova:port uuid="50d4d10f-b23e-4c72-9d38-e0aab324cfcb">
Aug 16 15:40:08 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 15:40:08 user nova-compute[73091]:         </nova:port>
Aug 16 15:40:08 user nova-compute[73091]:       </nova:ports>
Aug 16 15:40:08 user nova-compute[73091]:     </nova:instance>
Aug 16 15:40:08 user nova-compute[73091]:   </metadata>
Aug 16 15:40:08 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:40:08 user nova-compute[73091]:     <system>
Aug 16 15:40:08 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:40:08 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:40:08 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:40:08 user nova-compute[73091]:       <entry name="serial">93d31298-ac2f-42b7-acb4-f74d3eaf11b6</entry>
Aug 16 15:40:08 user nova-compute[73091]:       <entry name="uuid">93d31298-ac2f-42b7-acb4-f74d3eaf11b6</entry>
Aug 16 15:40:08 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:40:08 user nova-compute[73091]:     </system>
Aug 16 15:40:08 user nova-compute[73091]:   </sysinfo>
Aug 16 15:40:08 user nova-compute[73091]:   <os>
Aug 16 15:40:08 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:40:08 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:40:08 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:40:08 user nova-compute[73091]:   </os>
Aug 16 15:40:08 user nova-compute[73091]:   <features>
Aug 16 15:40:08 user nova-compute[73091]:     <acpi/>
Aug 16 15:40:08 user nova-compute[73091]:     <apic/>
Aug 16 15:40:08 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:40:08 user nova-compute[73091]:   </features>
Aug 16 15:40:08 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:40:08 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:40:08 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:40:08 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:40:08 user nova-compute[73091]:   </clock>
Aug 16 15:40:08 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:40:08 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:40:08 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:40:08 user nova-compute[73091]:   </cpu>
Aug 16 15:40:08 user nova-compute[73091]:   <devices>
Aug 16 15:40:08 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:40:08 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:40:08 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk"/>
Aug 16 15:40:08 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:40:08 user nova-compute[73091]:     </disk>
Aug 16 15:40:08 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:40:08 user nova-compute[73091]:       <mac address="fa:16:3e:af:2e:88"/>
Aug 16 15:40:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:40:08 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:40:08 user nova-compute[73091]:       <target dev="tap50d4d10f-b2"/>
Aug 16 15:40:08 user nova-compute[73091]:     </interface>
Aug 16 15:40:08 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:40:08 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/console.log" append="off"/>
Aug 16 15:40:08 user nova-compute[73091]:     </serial>
Aug 16 15:40:08 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:40:08 user nova-compute[73091]:     <video>
Aug 16 15:40:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:40:08 user nova-compute[73091]:     </video>
Aug 16 15:40:08 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:40:08 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:40:08 user nova-compute[73091]:     </rng>
Aug 16 15:40:08 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:40:08 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:40:08 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:40:08 user nova-compute[73091]:     </memballoon>
Aug 16 15:40:08 user nova-compute[73091]:   </devices>
Aug 16 15:40:08 user nova-compute[73091]: </domain>
Aug 16 15:40:08 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1256921909',display_name='tempest-AttachVolumeNegativeTest-server-1256921909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1256921909',id=51,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5J+ZIhvtOZtKHIMYlQMHYpgLAZQvkVhmTVnrrCESnAkcvBppuhH1/6FRaeXm53Jhdz6b2Dk96nOHIZNq+jWRKhXNxEbm/GmIU0wIFMlp2qKznFjNP7evomJf0K4qc/nw==',key_name='tempest-keypair-1030540885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-w8ro76gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=93d31298-ac2f-42b7-acb4-f74d3eaf11b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG os_vif [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50d4d10f-b2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50d4d10f-b2, col_values=(('external_ids', {'iface-id': '50d4d10f-b23e-4c72-9d38-e0aab324cfcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:2e:88', 'vm-uuid': '93d31298-ac2f-42b7-acb4-f74d3eaf11b6'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:08 user nova-compute[73091]: INFO os_vif [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2')
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:40:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:af:2e:88, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:40:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updated VIF entry in instance network info cache for port 50d4d10f-b23e-4c72-9d38-e0aab324cfcb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:40:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating instance_info_cache with network_info: [{"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:40:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cf89e287-d6f1-4cc6-9f0f-8a68d1d81d04 req-ea1b5669-a987-40e3-8180-de82a3f4d201 service nova] Releasing lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b532d9c-e05d-476b-9545-940b76f3b027 req-6c4b34f0-bf0b-416f-abbf-6f0587f2208c service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b532d9c-e05d-476b-9545-940b76f3b027 req-6c4b34f0-bf0b-416f-abbf-6f0587f2208c service nova] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b532d9c-e05d-476b-9545-940b76f3b027 req-6c4b34f0-bf0b-416f-abbf-6f0587f2208c service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b532d9c-e05d-476b-9545-940b76f3b027 req-6c4b34f0-bf0b-416f-abbf-6f0587f2208c service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b532d9c-e05d-476b-9545-940b76f3b027 req-6c4b34f0-bf0b-416f-abbf-6f0587f2208c service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] No waiting events found dispatching network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:40:10 user nova-compute[73091]: WARNING nova.compute.manager [req-9b532d9c-e05d-476b-9545-940b76f3b027 req-6c4b34f0-bf0b-416f-abbf-6f0587f2208c service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received unexpected event network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb for instance with vm_state building and task_state spawning.
Aug 16 15:40:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200412.3415947, 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] VM Resumed (Lifecycle Event)
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Instance spawned successfully.
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200412.3432484, 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] VM Started (Lifecycle Event)
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-f521ec3a-f111-421f-b34e-502c6f63f914 req-5134b50e-5147-4d59-bef7-aa3f790dc620 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f521ec3a-f111-421f-b34e-502c6f63f914 req-5134b50e-5147-4d59-bef7-aa3f790dc620 service nova] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f521ec3a-f111-421f-b34e-502c6f63f914 req-5134b50e-5147-4d59-bef7-aa3f790dc620 service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f521ec3a-f111-421f-b34e-502c6f63f914 req-5134b50e-5147-4d59-bef7-aa3f790dc620 service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-f521ec3a-f111-421f-b34e-502c6f63f914 req-5134b50e-5147-4d59-bef7-aa3f790dc620 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] No waiting events found dispatching network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:40:12 user nova-compute[73091]: WARNING nova.compute.manager [req-f521ec3a-f111-421f-b34e-502c6f63f914 req-5134b50e-5147-4d59-bef7-aa3f790dc620 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received unexpected event network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb for instance with vm_state building and task_state spawning.
Aug 16 15:40:12 user nova-compute[73091]: INFO nova.compute.manager [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Took 6.40 seconds to build instance.
Aug 16 15:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dd2c8a76-2973-43b3-96fd-68887cb4b812 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.505s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:40:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:40:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:40:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:40:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:40:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=25.235363006591797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 64053a48-46ff-493b-9356-ae1316e760a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:40:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:40:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:40:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:40:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-changed-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:40:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Refreshing instance network info cache due to event network-changed-4a92568f-3a86-41b1-ae2a-dfd41a5128f0. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:40:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] Acquiring lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:40:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] Acquired lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:40:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Refreshing network info cache for port 4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updated VIF entry in instance network info cache for port 4a92568f-3a86-41b1-ae2a-dfd41a5128f0. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-347140b2-5363-47c4-a9f0-201c93ad7db6 req-18eb70df-4eea-4cbc-8d40-43de5ce46f71 service nova] Releasing lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'flavor' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:00 user nova-compute[73091]: INFO nova.compute.manager [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attaching volume 9f92f90f-b738-466b-a85f-7b50a6a1486f to /dev/vdb
Aug 16 15:41:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2d0ed-4e86-4326-aea4-5f3b3df32fa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a37992-dc74-4c88-8309-f3bc9f8d953c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4de1b1e-4a9d-41f2-976e-5ee90e0cbf59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a686a-3423-4d26-aa10-d7bd61398e07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:41:00 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:41:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d08dca6-e142-4ee3-9edc-14851c2c8139]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:41:00 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating existing volume attachment record: 46ddac9a-b897-4098-8e87-bfc0878f23e8 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:41:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHMykAJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:41:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:41:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:41:10 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3216b058-70d0-4058-b5ad-a1911a948cbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:41:10 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40036772-a7e3-442a-a90a-e2ed4a7762af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f] added
Aug 16 15:41:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[337d3acc-da96-4915-bbc5-c8b77cb66ca8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8051fd1-38d5-4179-9983-646a3c94e059]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHMykAJf {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHMykAJf" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16bc0a2-ed55-4cda-bc33-bd012401bd20]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dHMykAJf'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdcf328-08ee-4d22-9fa5-84399c588f4e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5134ae04-9998-4b26-b514-6c253ed341aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:41:10 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:41:10 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:41:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:41:10 user nova-compute[73091]: 
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a9a3a-3f60-4e88-8b0d-5d7f06b22e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260]
Aug 16 15:41:10 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260] successful.
Aug 16 15:41:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb47112d-e0d6-458d-91d0-adecc4e8d545]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dc69ad-dd44-43e4-9183-74aa11ba8c57]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa602ee6-a329-419c-a546-3315113c30ba]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:41:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHMykAJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:41:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:41:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26139653231636135', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:41:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139653231636135', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:41:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'flavor' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:41:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:41:11 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:41:11 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:41:11 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:41:11 user nova-compute[73091]:   <serial>9f92f90f-b738-466b-a85f-7b50a6a1486f</serial>
Aug 16 15:41:11 user nova-compute[73091]: </disk>
Aug 16 15:41:11 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:41:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:41:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:41:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No VIF found with MAC fa:16:3e:bb:5b:3d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cc3d284-8425-4af0-8168-e3fd26d74bca tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.727s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'flavor' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:15 user nova-compute[73091]: INFO nova.compute.manager [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attaching volume 1d7443d3-b741-4fff-aa50-4c4412547f10 to /dev/vdc
Aug 16 15:41:16 user nova-compute[73091]: DEBUG os_brick.utils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abded716-d28b-425d-82c1-2fa8873cc15b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8ee67b-c41e-49d7-9c86-80e25f52f084]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d1381-337f-4cb1-89ad-a83abbf4b701]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c925199-eb54-42ff-87a1-6aebf2a6e36d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:41:16 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:41:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80f8040-58f5-4ed7-87d5-ba404f727801]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG os_brick.utils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:41:16 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating existing volume attachment record: 85ffe99e-e697-40ff-a5e2-3c347d08b0d8 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:41:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:41:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:41:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:41:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sizUTYjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:41:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:41:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:41:26 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53c2185-5e02-414c-893b-568ea0bf60ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:41:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0374123-6daa-498c-b138-ad7f9542be41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10] added
Aug 16 15:41:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b9d64-e21c-4052-a4c0-25a406a4ec5a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[404f6c01-d663-48b9-9a00-d3e5dcbec928]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sizUTYjC {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sizUTYjC" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[711fc90e-e306-40ae-8d40-e564a755f2cc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sizUTYjC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[11171723-edfe-4f2f-9272-c1fc94aab6d5]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[da112151-7a12-4bbe-beca-6aceafc05bed]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55bb277-30b9-46d8-a6ef-94d8f7933164]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260]
Aug 16 15:41:26 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260] successful.
Aug 16 15:41:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f0abd0-f236-4468-a5e3-89e1829a898b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd62d93b-3f2c-48f0-8522-3ee606783784]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:26 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 (non-flash)
Aug 16 15:41:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:26 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 (non-flash)
Aug 16 15:41:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de04952a-660c-4d09-8995-550e52f5a55b]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:41:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sizUTYjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:41:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:41:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26439326564643463', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:41:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439326564643463', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:41:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'flavor' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:41:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:41:27 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:41:27 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:41:27 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:41:27 user nova-compute[73091]:   <serial>1d7443d3-b741-4fff-aa50-4c4412547f10</serial>
Aug 16 15:41:27 user nova-compute[73091]: </disk>
Aug 16 15:41:27 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] No VIF found with MAC fa:16:3e:bb:5b:3d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-09bfcdbe-02f5-4560-82d3-a67b25e895d2 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.194s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:41:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:29 user nova-compute[73091]: INFO nova.compute.manager [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Detaching volume 1d7443d3-b741-4fff-aa50-4c4412547f10
Aug 16 15:41:29 user nova-compute[73091]: INFO nova.virt.block_device [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attempting to driver detach volume 1d7443d3-b741-4fff-aa50-4c4412547f10 from mountpoint /dev/vdc
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Attempting to detach device vdc from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:41:29 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:41:29 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:41:29 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:41:29 user nova-compute[73091]:   <serial>1d7443d3-b741-4fff-aa50-4c4412547f10</serial>
Aug 16 15:41:29 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 15:41:29 user nova-compute[73091]: </disk>
Aug 16 15:41:29 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:41:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Successfully detached device vdc from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the persistent domain config.
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:41:29 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:41:29 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:41:29 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 15:41:29 user nova-compute[73091]:   <serial>1d7443d3-b741-4fff-aa50-4c4412547f10</serial>
Aug 16 15:41:29 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 15:41:29 user nova-compute[73091]: </disk>
Aug 16 15:41:29 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692200489.5761962, 64053a48-46ff-493b-9356-ae1316e760a5 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:41:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Successfully detached device vdc from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the live domain config.
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sizUTYjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:41:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b344c8c-ace3-46a4-97be-f0b29453f867]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df68155-ee8b-4885-9cfc-5376645d32aa]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:29 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 (non-flash)
Aug 16 15:41:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:41:29 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 (non-flash)
Aug 16 15:41:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c4e6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc44412-526e-418e-9316-ba0eb05d12b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[33226225-8bc4-4cf7-b2a2-3cf81c8859f1]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e7c30e-473b-4a97-a651-97de32582773]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c45a04-d551-4b2d-b04e-6b0c23dd4dac]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b500c659-4df0-4e6a-beac-71b997a0b5bc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a914a6-97c6-4991-ae8f-ebae811e556f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260]
Aug 16 15:41:29 user nova-compute[73091]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10, portal: 172.16.0.220,3260] successful.
Aug 16 15:41:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d7443d3-b741-4fff-aa50-4c4412547f10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9774276-1814-4d8b-949d-7863118b5216]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] <== disconnect_volume: return (271ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:41:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:41:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'flavor' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:41:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6fa0c2d6-d6a5-4184-8eb8-3c4342fe7d3f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.647s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:41:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:41:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:41:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:41:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:41:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:41:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating instance_info_cache with network_info: [{"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:41:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:41:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:41:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:41:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.233566284179688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 64053a48-46ff-493b-9356-ae1316e760a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:41:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:41:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:41:42 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:41:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:41:42 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:41:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:41:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:41:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:41:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-changed-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Refreshing instance network info cache due to event network-changed-50d4d10f-b23e-4c72-9d38-e0aab324cfcb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] Acquiring lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] Acquired lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Refreshing network info cache for port 50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updated VIF entry in instance network info cache for port 50d4d10f-b23e-4c72-9d38-e0aab324cfcb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating instance_info_cache with network_info: [{"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d3858b1-ff94-445c-8f62-ec1e2841d3a3 req-33c515a9-4c5b-424b-b002-fff13a5c3437 service nova] Releasing lock "refresh_cache-93d31298-ac2f-42b7-acb4-f74d3eaf11b6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:41:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:41:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:42:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:42:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:42:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:42:02 user nova-compute[73091]: INFO nova.compute.manager [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Attaching volume 582b6729-48f6-41e6-babc-b60c162eaa76 to /dev/vdb
Aug 16 15:42:02 user nova-compute[73091]: DEBUG os_brick.utils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438e7d9-fc80-4d01-be04-58c3ea086906]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdf1951-e934-41be-a70c-93c1746c750a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dba42e0-e5cf-476d-9f48-53c1dca80711]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d1c11-0638-4283-968f-699c5c51977e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:42:02 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:42:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca2506a-e02d-4cfc-92b2-d3a3f66b01f6]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG os_brick.utils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:42:02 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating existing volume attachment record: c2a73203-eec8-40e4-8571-9c4ef766a87e {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:42:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIDqBgsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:42:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:42:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:42:12 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4157d0-be55-4e3e-b593-03ca9ac03a6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:42:12 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa42254a-f5c7-4268-bf83-0dbcd2d9ce16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76] added
Aug 16 15:42:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff8f45-5bba-4ef8-9e5e-e0b6e35ec2cf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718d270-88fd-460f-a6e2-739debdd9143]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIDqBgsA {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIDqBgsA" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d71c36-c403-474f-836e-733751622500]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fIDqBgsA'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc000d-433c-4764-b86b-afa297170865]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea376f-8079-4adf-9afe-7edbcf20dea3]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4172ff1-fcff-43d9-bdc9-e5c1acf8874c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260]
Aug 16 15:42:12 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260] successful.
Aug 16 15:42:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856d5c6-326a-4688-8aa2-2712ea0e3c3c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4cd32c-79f0-436c-937a-322bde71c40d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:12 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 (non-flash)
Aug 16 15:42:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:12 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 (non-flash)
Aug 16 15:42:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610ec05-bfff-455e-8f4b-4743283091d6]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIDqBgsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23032653465656463', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032653465656463', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:42:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:42:13 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:42:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:42:13 user nova-compute[73091]:   <serial>582b6729-48f6-41e6-babc-b60c162eaa76</serial>
Aug 16 15:42:13 user nova-compute[73091]: </disk>
Aug 16 15:42:13 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] No VIF found with MAC fa:16:3e:af:2e:88, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3064f7dc-0322-4a96-9739-04c4c2739bb5 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.975s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:42:15 user nova-compute[73091]: INFO nova.compute.manager [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Detaching volume 582b6729-48f6-41e6-babc-b60c162eaa76
Aug 16 15:42:15 user nova-compute[73091]: INFO nova.virt.block_device [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Attempting to driver detach volume 582b6729-48f6-41e6-babc-b60c162eaa76 from mountpoint /dev/vdb
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Attempting to detach device vdb from instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:42:15 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:42:15 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:42:15 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:42:15 user nova-compute[73091]:   <serial>582b6729-48f6-41e6-babc-b60c162eaa76</serial>
Aug 16 15:42:15 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:42:15 user nova-compute[73091]: </disk>
Aug 16 15:42:15 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:42:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully detached device vdb from instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 from the persistent domain config.
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:42:15 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:42:15 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 15:42:15 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:42:15 user nova-compute[73091]:   <serial>582b6729-48f6-41e6-babc-b60c162eaa76</serial>
Aug 16 15:42:15 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:42:15 user nova-compute[73091]: </disk>
Aug 16 15:42:15 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692200535.5981178, 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:42:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully detached device vdb from instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 from the live domain config.
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIDqBgsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:42:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884ddec-949b-4172-9f92-019eef9682eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d976bfe-7567-43c6-9c1e-ec825e45518b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:15 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 (non-flash)
Aug 16 15:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:15 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 (non-flash)
Aug 16 15:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c233d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aede1155-a3ef-4b1f-9f5c-d0c0abef07c2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d28cfa-495c-49e1-a85c-8fad40c4b438]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67078fe0-f8a5-4915-bcbc-8251f2958cbf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c7e74-c278-43d9-8660-fc24d44303cf]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e31bb7-492e-4d35-8729-1052df8d3b3d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51f94c9-bde1-4643-b869-69fa68134cb6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260]
Aug 16 15:42:15 user nova-compute[73091]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76, portal: 172.16.0.220,3260] successful.
Aug 16 15:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582b6729-48f6-41e6-babc-b60c162eaa76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a2a47-3d62-4b98-906a-977d1c4d4fc7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] <== disconnect_volume: return (284ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:42:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'flavor' on Instance uuid 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d507952-74bf-4a81-a806-4098e277b2bb tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.601s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:42:19 user nova-compute[73091]: INFO nova.compute.manager [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Detaching volume 9f92f90f-b738-466b-a85f-7b50a6a1486f
Aug 16 15:42:19 user nova-compute[73091]: INFO nova.virt.block_device [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Attempting to driver detach volume 9f92f90f-b738-466b-a85f-7b50a6a1486f from mountpoint /dev/vdb
Aug 16 15:42:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Attempting to detach device vdb from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:42:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:42:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:42:19 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:42:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:42:19 user nova-compute[73091]:   <serial>9f92f90f-b738-466b-a85f-7b50a6a1486f</serial>
Aug 16 15:42:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:42:19 user nova-compute[73091]: </disk>
Aug 16 15:42:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:42:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Successfully detached device vdb from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the persistent domain config.
Aug 16 15:42:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:42:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:42:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:42:19 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:42:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:42:19 user nova-compute[73091]:   <serial>9f92f90f-b738-466b-a85f-7b50a6a1486f</serial>
Aug 16 15:42:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:42:19 user nova-compute[73091]: </disk>
Aug 16 15:42:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692200540.0713735, 64053a48-46ff-493b-9356-ae1316e760a5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:42:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Successfully detached device vdb from instance 64053a48-46ff-493b-9356-ae1316e760a5 from the live domain config.
Aug 16 15:42:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHMykAJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:42:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7bbe1d-a6fc-4692-a114-760240554a37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbec95b-cb36-419b-98a0-5f41dd7ef085]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f (non-flash)
Aug 16 15:42:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115444bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adef3e4-cebe-4001-9ba7-1c6301e304a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65796d4-a274-48d6-ae6b-4369a856bc96]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a880370-62ea-4358-9c3c-1081ec15eafd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88a9ca-ab3b-491c-8f13-bc37bdf14be5]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9fc405-9a6e-430a-a79f-0bcad2c04e46]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[231598d2-8cb9-4430-8d9f-564e699660ae]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260]
Aug 16 15:42:20 user nova-compute[73091]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f, portal: 172.16.0.220,3260] successful.
Aug 16 15:42:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f92f90f-b738-466b-a85f-7b50a6a1486f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83cdbb9-3bb3-4263-8088-643f276dd3cf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] <== disconnect_volume: return (254ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:42:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:42:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'flavor' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f64ae2b3-31d0-4f75-8f6d-5bca2c20e97f tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [{"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-64053a48-46ff-493b-9356-ae1316e760a5" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:42:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:42:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:42:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.232345581054688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 64053a48-46ff-493b-9356-ae1316e760a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:05 user nova-compute[73091]: INFO nova.compute.manager [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Terminating instance
Aug 16 15:43:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-c61e4dc6-9336-426f-aba0-9382d4059ec4 req-fc05e6e1-bca4-49e6-89a9-705f71793a40 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-vif-unplugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c61e4dc6-9336-426f-aba0-9382d4059ec4 req-fc05e6e1-bca4-49e6-89a9-705f71793a40 service nova] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c61e4dc6-9336-426f-aba0-9382d4059ec4 req-fc05e6e1-bca4-49e6-89a9-705f71793a40 service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c61e4dc6-9336-426f-aba0-9382d4059ec4 req-fc05e6e1-bca4-49e6-89a9-705f71793a40 service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-c61e4dc6-9336-426f-aba0-9382d4059ec4 req-fc05e6e1-bca4-49e6-89a9-705f71793a40 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] No waiting events found dispatching network-vif-unplugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-c61e4dc6-9336-426f-aba0-9382d4059ec4 req-fc05e6e1-bca4-49e6-89a9-705f71793a40 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-vif-unplugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:43:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Instance destroyed successfully.
Aug 16 15:43:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lazy-loading 'resources' on Instance uuid 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1256921909',display_name='tempest-AttachVolumeNegativeTest-server-1256921909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1256921909',id=51,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5J+ZIhvtOZtKHIMYlQMHYpgLAZQvkVhmTVnrrCESnAkcvBppuhH1/6FRaeXm53Jhdz6b2Dk96nOHIZNq+jWRKhXNxEbm/GmIU0wIFMlp2qKznFjNP7evomJf0K4qc/nw==',key_name='tempest-keypair-1030540885',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62db39d6754641d89841f031b210383b',ramdisk_id='',reservation_id='r-w8ro76gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2024154116',owner_user_name='tempest-AttachVolumeNegativeTest-2024154116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='043ba186a9b4416c903393c25a4a87d6',uuid=93d31298-ac2f-42b7-acb4-f74d3eaf11b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converting VIF {"id": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "address": "fa:16:3e:af:2e:88", "network": {"id": "5cc4917a-be0b-4c48-b093-bb50215f4f53", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1402522119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62db39d6754641d89841f031b210383b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d4d10f-b2", "ovs_interfaceid": "50d4d10f-b23e-4c72-9d38-e0aab324cfcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG os_vif [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50d4d10f-b2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:06 user nova-compute[73091]: INFO os_vif [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb,network=Network(5cc4917a-be0b-4c48-b093-bb50215f4f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d4d10f-b2')
Aug 16 15:43:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Deleting instance files /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6_del
Aug 16 15:43:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Deletion of /opt/stack/data/nova/instances/93d31298-ac2f-42b7-acb4-f74d3eaf11b6_del complete
Aug 16 15:43:06 user nova-compute[73091]: INFO nova.compute.manager [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 15:43:06 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:43:06 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:43:07 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Took 0.86 seconds to deallocate network for instance.
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a616a51-f283-45f0-b462-8e480b42a9e7 req-ca0cdb1c-2525-4d66-8c55-8e85ad9c5625 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-vif-deleted-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:43:07 user nova-compute[73091]: INFO nova.compute.manager [req-5a616a51-f283-45f0-b462-8e480b42a9e7 req-ca0cdb1c-2525-4d66-8c55-8e85ad9c5625 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Neutron deleted interface 50d4d10f-b23e-4c72-9d38-e0aab324cfcb; detaching it from the instance and deleting it from the info cache
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-5a616a51-f283-45f0-b462-8e480b42a9e7 req-ca0cdb1c-2525-4d66-8c55-8e85ad9c5625 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a616a51-f283-45f0-b462-8e480b42a9e7 req-ca0cdb1c-2525-4d66-8c55-8e85ad9c5625 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Detach interface failed, port_id=50d4d10f-b23e-4c72-9d38-e0aab324cfcb, reason: Instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:07 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Deleted allocations for instance 93d31298-ac2f-42b7-acb4-f74d3eaf11b6
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27407f95-f0c4-4da4-bd2b-7537b534f486 tempest-AttachVolumeNegativeTest-2024154116 tempest-AttachVolumeNegativeTest-2024154116-project-member] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d6105a5-355e-4f51-ae5e-7681bf9e16fe req-6e85bd76-495f-4d45-8817-32b613905820 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received event network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d6105a5-355e-4f51-ae5e-7681bf9e16fe req-6e85bd76-495f-4d45-8817-32b613905820 service nova] Acquiring lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d6105a5-355e-4f51-ae5e-7681bf9e16fe req-6e85bd76-495f-4d45-8817-32b613905820 service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d6105a5-355e-4f51-ae5e-7681bf9e16fe req-6e85bd76-495f-4d45-8817-32b613905820 service nova] Lock "93d31298-ac2f-42b7-acb4-f74d3eaf11b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d6105a5-355e-4f51-ae5e-7681bf9e16fe req-6e85bd76-495f-4d45-8817-32b613905820 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] No waiting events found dispatching network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:43:07 user nova-compute[73091]: WARNING nova.compute.manager [req-8d6105a5-355e-4f51-ae5e-7681bf9e16fe req-6e85bd76-495f-4d45-8817-32b613905820 service nova] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Received unexpected event network-vif-plugged-50d4d10f-b23e-4c72-9d38-e0aab324cfcb for instance with vm_state deleted and task_state None.
Aug 16 15:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:09 user nova-compute[73091]: INFO nova.compute.manager [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Terminating instance
Aug 16 15:43:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a48963e-0fe8-41ed-89f2-bb5e77ec8545 req-d92dcb39-5897-447e-9e02-89d89c044a97 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-vif-unplugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a48963e-0fe8-41ed-89f2-bb5e77ec8545 req-d92dcb39-5897-447e-9e02-89d89c044a97 service nova] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a48963e-0fe8-41ed-89f2-bb5e77ec8545 req-d92dcb39-5897-447e-9e02-89d89c044a97 service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a48963e-0fe8-41ed-89f2-bb5e77ec8545 req-d92dcb39-5897-447e-9e02-89d89c044a97 service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a48963e-0fe8-41ed-89f2-bb5e77ec8545 req-d92dcb39-5897-447e-9e02-89d89c044a97 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] No waiting events found dispatching network-vif-unplugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a48963e-0fe8-41ed-89f2-bb5e77ec8545 req-d92dcb39-5897-447e-9e02-89d89c044a97 service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-vif-unplugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:43:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Instance destroyed successfully.
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lazy-loading 'resources' on Instance uuid 64053a48-46ff-493b-9356-ae1316e760a5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-530137032',display_name='tempest-TestServerVolumeAttachmentScenario-server-530137032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-530137032',id=50,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb5WljC5Sh87zOwB2DMJ1P1UH0lYLr4lEGXX02XAH1R47dcgmwWWMyVnPTYDKWCBw4C9oDicRURVzR8JORn5YMaJGDWyEcj2JZ4GrDFROENjpjEBoUX6rusifvFH7Q8kg==',key_name='tempest-keypair-563236393',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:39:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a3aaf6f56641839b51462f9cc2a16d',ramdisk_id='',reservation_id='r-rravy7ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-809955122',owner_user_name='tempest-TestServerVolumeAttachmentScenario-809955122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10201a1ac71e40389eac6a82faa44aa7',uuid=64053a48-46ff-493b-9356-ae1316e760a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Converting VIF {"id": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "address": "fa:16:3e:bb:5b:3d", "network": {"id": "4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2040252471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a3aaf6f56641839b51462f9cc2a16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a92568f-3a", "ovs_interfaceid": "4a92568f-3a86-41b1-ae2a-dfd41a5128f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG os_vif [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a92568f-3a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:10 user nova-compute[73091]: INFO os_vif [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5b:3d,bridge_name='br-int',has_traffic_filtering=True,id=4a92568f-3a86-41b1-ae2a-dfd41a5128f0,network=Network(4ad2eacf-b0d9-4bdf-bb2f-8eb4a45a4a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a92568f-3a')
Aug 16 15:43:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Deleting instance files /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5_del
Aug 16 15:43:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Deletion of /opt/stack/data/nova/instances/64053a48-46ff-493b-9356-ae1316e760a5_del complete
Aug 16 15:43:11 user nova-compute[73091]: INFO nova.compute.manager [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 16 15:43:11 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:43:11 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:43:11 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:43:12 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Took 1.03 seconds to deallocate network for instance.
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.099s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:12 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Deleted allocations for instance 64053a48-46ff-493b-9356-ae1316e760a5
Aug 16 15:43:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] Acquiring lock "64053a48-46ff-493b-9356-ae1316e760a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] Lock "64053a48-46ff-493b-9356-ae1316e760a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] No waiting events found dispatching network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:43:12 user nova-compute[73091]: WARNING nova.compute.manager [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received unexpected event network-vif-plugged-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 for instance with vm_state deleted and task_state None.
Aug 16 15:43:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-b7ab0217-ecfe-4f1b-8330-0a56b2f6e9bf req-40e30bd4-671c-4c42-8c92-81379dbf0edb service nova] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Received event network-vif-deleted-4a92568f-3a86-41b1-ae2a-dfd41a5128f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:43:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-db6968ca-3bbd-4191-a9db-1479815bb9f3 tempest-TestServerVolumeAttachmentScenario-809955122 tempest-TestServerVolumeAttachmentScenario-809955122-project-member] Lock "64053a48-46ff-493b-9356-ae1316e760a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:21 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200586.160369, 93d31298-ac2f-42b7-acb4-f74d3eaf11b6 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:43:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] VM Stopped (Lifecycle Event)
Aug 16 15:43:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ceda9d94-6625-4db7-9b1e-7e4df1bcf73c None None] [instance: 93d31298-ac2f-42b7-acb4-f74d3eaf11b6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200590.6313314, 64053a48-46ff-493b-9356-ae1316e760a5 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:43:25 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] VM Stopped (Lifecycle Event)
Aug 16 15:43:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b301eea1-b7b4-4ddf-a055-ffa76b84e255 None None] [instance: 64053a48-46ff-493b-9356-ae1316e760a5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:43:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:43:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:43:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8886MB free_disk=25.287410736083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:43:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:43:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:43:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:43:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:43:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:43:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:43:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:43:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:43:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:43:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:43:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:44:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:44:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:44:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:44:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:44:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:44:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:44:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:44:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.285179138183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:44:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:44:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:44:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:44:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:45:24 user nova-compute[73091]: INFO nova.compute.claims [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Claim successful on node user
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:45:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:45:24 user nova-compute[73091]: INFO nova.virt.block_device [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Booting with volume 6a073dc8-a61e-4837-82ad-e9060406b5cb at /dev/vda
Aug 16 15:45:24 user nova-compute[73091]: DEBUG nova.policy [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a9c0ba18b7742868de0162a427d517d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bc952ced574166b16e806db3c7f10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG os_brick.utils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:45:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc82695-099e-4b2b-ab53-c20b8b0824a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfe1351-29f9-4f43-97ab-c0534feed100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef979fa-f530-47f8-8d20-b61b680ea85c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0e1ef-1331-445f-b979-2855acad3535]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:45:25 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:45:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599ed40-c805-4082-8176-17afbc308888]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG os_brick.utils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating existing volume attachment record: 1834dae6-6eb2-4949-9a16-70555df0b9cc {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Successfully created port: 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:45:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Successfully updated port: 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing instance network info cache due to event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:45:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance network_info: |[{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated VIF entry in instance network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:45:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23f7cd7f-8a8e-4c48-83a8-05ddfa95b808 req-978c2aac-79ae-4250-8ad9-a8a3adf0b833 service nova] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:45:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:45:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Creating image(s)
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Ensure instance console log exists: /opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Start _get_guest_xml network_info=[{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '1834dae6-6eb2-4949-9a16-70555df0b9cc', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7ead4ad-e491-4d98-81d6-355ac42ef0fe', 'attached_at': '', 'detached_at': '', 'volume_id': '6a073dc8-a61e-4837-82ad-e9060406b5cb', 'serial': '6a073dc8-a61e-4837-82ad-e9060406b5cb'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:45:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:45:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:45:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:45:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:45:35 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6892f6fb-1fcd-40f0-9eb7-e56f478b66bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:45:35 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d95480-2ab1-48d3-826a-9ae6eff84bf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb] added
Aug 16 15:45:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e386f7-4ec5-40c9-8a25-e125937fea92]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[45acc76e-55a7-4762-a808-7ad67d8e87d2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCVMalSs {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCVMalSs" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de787fb-a373-414e-a5b5-ac67f8002cdd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCVMalSs'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d7b45-f475-4a78-b0de-0397cf303776]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c103b5-f382-4cbc-a141-30f5f108a9ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:45:35 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:45:35 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:45:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:45:35 user nova-compute[73091]: 
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a41747-e245-4aa2-b4f4-91848108f19d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]
Aug 16 15:45:35 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.
Aug 16 15:45:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e7397-859b-477b-bc34-4fbcdd10bc76]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02bc8f1-2d59-40a9-a1bd-6d7b96528211]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:45:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:45:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e077e9a-e258-4fb2-b381-a98c206e26d4]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:45:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23631346262346132', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346262346132', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948095263',display_name='tempest-TestShelveInstance-server-1948095263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948095263',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihfTlhnhDkN/KZnJC/NJJfdexVXZa6uxNr1ED8N594gkZvEkDP0KUUc92/ocYPc3K95+Rn/HxJGPMuT35bIxFBYlNG5IEi+6txd5qH/rVXDyPbozG4n3TIm3BxzocYzA==',key_name='tempest-TestShelveInstance-1280995366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bc952ced574166b16e806db3c7f10c',ramdisk_id='',reservation_id='r-cugooytk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-908151640',owner_user_name='tempest-TestShelveInstance-908151640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:45:25Z,user_data=None,user_id='6a9c0ba18b7742868de0162a427d517d',uuid=b7ead4ad-e491-4d98-81d6-355ac42ef0fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converting VIF {"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'pci_devices' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:45:36 user nova-compute[73091]:   <uuid>b7ead4ad-e491-4d98-81d6-355ac42ef0fe</uuid>
Aug 16 15:45:36 user nova-compute[73091]:   <name>instance-00000034</name>
Aug 16 15:45:36 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:45:36 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:45:36 user nova-compute[73091]:   <metadata>
Aug 16 15:45:36 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:45:36 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:45:36 user nova-compute[73091]:       <nova:name>tempest-TestShelveInstance-server-1948095263</nova:name>
Aug 16 15:45:36 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:45:35</nova:creationTime>
Aug 16 15:45:36 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:45:36 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:45:36 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:45:36 user nova-compute[73091]:       <nova:owner>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:user uuid="6a9c0ba18b7742868de0162a427d517d">tempest-TestShelveInstance-908151640-project-member</nova:user>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:project uuid="d5bc952ced574166b16e806db3c7f10c">tempest-TestShelveInstance-908151640</nova:project>
Aug 16 15:45:36 user nova-compute[73091]:       </nova:owner>
Aug 16 15:45:36 user nova-compute[73091]:       <nova:ports>
Aug 16 15:45:36 user nova-compute[73091]:         <nova:port uuid="515219ba-2ddc-4398-8647-489f3eed8d15">
Aug 16 15:45:36 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:45:36 user nova-compute[73091]:         </nova:port>
Aug 16 15:45:36 user nova-compute[73091]:       </nova:ports>
Aug 16 15:45:36 user nova-compute[73091]:     </nova:instance>
Aug 16 15:45:36 user nova-compute[73091]:   </metadata>
Aug 16 15:45:36 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:45:36 user nova-compute[73091]:     <system>
Aug 16 15:45:36 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:45:36 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:45:36 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:45:36 user nova-compute[73091]:       <entry name="serial">b7ead4ad-e491-4d98-81d6-355ac42ef0fe</entry>
Aug 16 15:45:36 user nova-compute[73091]:       <entry name="uuid">b7ead4ad-e491-4d98-81d6-355ac42ef0fe</entry>
Aug 16 15:45:36 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:45:36 user nova-compute[73091]:     </system>
Aug 16 15:45:36 user nova-compute[73091]:   </sysinfo>
Aug 16 15:45:36 user nova-compute[73091]:   <os>
Aug 16 15:45:36 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:45:36 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:45:36 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:45:36 user nova-compute[73091]:   </os>
Aug 16 15:45:36 user nova-compute[73091]:   <features>
Aug 16 15:45:36 user nova-compute[73091]:     <acpi/>
Aug 16 15:45:36 user nova-compute[73091]:     <apic/>
Aug 16 15:45:36 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:45:36 user nova-compute[73091]:   </features>
Aug 16 15:45:36 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:45:36 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:45:36 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:45:36 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:45:36 user nova-compute[73091]:   </clock>
Aug 16 15:45:36 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:45:36 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:45:36 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:45:36 user nova-compute[73091]:   </cpu>
Aug 16 15:45:36 user nova-compute[73091]:   <devices>
Aug 16 15:45:36 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:45:36 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:45:36 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:45:36 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:45:36 user nova-compute[73091]:       <serial>6a073dc8-a61e-4837-82ad-e9060406b5cb</serial>
Aug 16 15:45:36 user nova-compute[73091]:     </disk>
Aug 16 15:45:36 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:45:36 user nova-compute[73091]:       <mac address="fa:16:3e:67:18:02"/>
Aug 16 15:45:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:45:36 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:45:36 user nova-compute[73091]:       <target dev="tap515219ba-2d"/>
Aug 16 15:45:36 user nova-compute[73091]:     </interface>
Aug 16 15:45:36 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:45:36 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe/console.log" append="off"/>
Aug 16 15:45:36 user nova-compute[73091]:     </serial>
Aug 16 15:45:36 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:45:36 user nova-compute[73091]:     <video>
Aug 16 15:45:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:45:36 user nova-compute[73091]:     </video>
Aug 16 15:45:36 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:45:36 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:45:36 user nova-compute[73091]:     </rng>
Aug 16 15:45:36 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:45:36 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:45:36 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:45:36 user nova-compute[73091]:     </memballoon>
Aug 16 15:45:36 user nova-compute[73091]:   </devices>
Aug 16 15:45:36 user nova-compute[73091]: </domain>
Aug 16 15:45:36 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948095263',display_name='tempest-TestShelveInstance-server-1948095263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948095263',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihfTlhnhDkN/KZnJC/NJJfdexVXZa6uxNr1ED8N594gkZvEkDP0KUUc92/ocYPc3K95+Rn/HxJGPMuT35bIxFBYlNG5IEi+6txd5qH/rVXDyPbozG4n3TIm3BxzocYzA==',key_name='tempest-TestShelveInstance-1280995366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bc952ced574166b16e806db3c7f10c',ramdisk_id='',reservation_id='r-cugooytk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-908151640',owner_user_name='tempest-TestShelveInstance-908151640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:45:25Z,user_data=None,user_id='6a9c0ba18b7742868de0162a427d517d',uuid=b7ead4ad-e491-4d98-81d6-355ac42ef0fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converting VIF {"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG os_vif [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap515219ba-2d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap515219ba-2d, col_values=(('external_ids', {'iface-id': '515219ba-2ddc-4398-8647-489f3eed8d15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:18:02', 'vm-uuid': 'b7ead4ad-e491-4d98-81d6-355ac42ef0fe'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:36 user nova-compute[73091]: INFO os_vif [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d')
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:45:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] No VIF found with MAC fa:16:3e:67:18:02, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-0bcbfe34-d11d-43b9-bf01-39379b263906 req-2be05e2b-d61e-4eee-a9d4-a2127104f769 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0bcbfe34-d11d-43b9-bf01-39379b263906 req-2be05e2b-d61e-4eee-a9d4-a2127104f769 service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0bcbfe34-d11d-43b9-bf01-39379b263906 req-2be05e2b-d61e-4eee-a9d4-a2127104f769 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0bcbfe34-d11d-43b9-bf01-39379b263906 req-2be05e2b-d61e-4eee-a9d4-a2127104f769 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-0bcbfe34-d11d-43b9-bf01-39379b263906 req-2be05e2b-d61e-4eee-a9d4-a2127104f769 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:45:37 user nova-compute[73091]: WARNING nova.compute.manager [req-0bcbfe34-d11d-43b9-bf01-39379b263906 req-2be05e2b-d61e-4eee-a9d4-a2127104f769 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state building and task_state spawning.
Aug 16 15:45:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200739.867598, b7ead4ad-e491-4d98-81d6-355ac42ef0fe => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] VM Resumed (Lifecycle Event)
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:45:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance spawned successfully.
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200739.8695953, b7ead4ad-e491-4d98-81d6-355ac42ef0fe => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] VM Started (Lifecycle Event)
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Took 4.80 seconds to spawn the instance on the hypervisor.
Aug 16 15:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:45:40 user nova-compute[73091]: INFO nova.compute.manager [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Took 15.61 seconds to build instance.
Aug 16 15:45:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-2610d793-7b34-4388-ae0c-20eda4f4b4f9 req-8255c26d-72ef-4287-aded-40fb57242de7 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2610d793-7b34-4388-ae0c-20eda4f4b4f9 req-8255c26d-72ef-4287-aded-40fb57242de7 service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2610d793-7b34-4388-ae0c-20eda4f4b4f9 req-8255c26d-72ef-4287-aded-40fb57242de7 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2610d793-7b34-4388-ae0c-20eda4f4b4f9 req-8255c26d-72ef-4287-aded-40fb57242de7 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-2610d793-7b34-4388-ae0c-20eda4f4b4f9 req-8255c26d-72ef-4287-aded-40fb57242de7 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:45:40 user nova-compute[73091]: WARNING nova.compute.manager [req-2610d793-7b34-4388-ae0c-20eda4f4b4f9 req-8255c26d-72ef-4287-aded-40fb57242de7 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state active and task_state None.
Aug 16 15:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d36d56e8-9042-482c-9c37-62377a0a6555 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.716s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:45:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:45:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:45:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:45:42 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.274085998535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:45:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7ead4ad-e491-4d98-81d6-355ac42ef0fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:45:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:45:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:45:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:45:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:45:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:45:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:45:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:45:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:45:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:45:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:45:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:46:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:46:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:46:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:46:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:46:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.27340316772461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:46:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7ead4ad-e491-4d98-81d6-355ac42ef0fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:46:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:46:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:46:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:46:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:46:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:46:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:46:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:47:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing instance network info cache due to event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:47:16 user nova-compute[73091]: INFO nova.compute.manager [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Shelve offloading
Aug 16 15:47:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated VIF entry in instance network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0151b404-736f-44d3-87b5-9338ea8666ee req-172ea9cc-3b35-4a0d-9ea6-4d7a09d38ff8 service nova] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c977809-8a76-4d11-b137-426bbedd2100 req-19cf40b4-8e8b-4151-a700-8a8a21b62650 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-unplugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c977809-8a76-4d11-b137-426bbedd2100 req-19cf40b4-8e8b-4151-a700-8a8a21b62650 service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c977809-8a76-4d11-b137-426bbedd2100 req-19cf40b4-8e8b-4151-a700-8a8a21b62650 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7c977809-8a76-4d11-b137-426bbedd2100 req-19cf40b4-8e8b-4151-a700-8a8a21b62650 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-7c977809-8a76-4d11-b137-426bbedd2100 req-19cf40b4-8e8b-4151-a700-8a8a21b62650 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-unplugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:47:17 user nova-compute[73091]: WARNING nova.compute.manager [req-7c977809-8a76-4d11-b137-426bbedd2100 req-19cf40b4-8e8b-4151-a700-8a8a21b62650 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-unplugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state active and task_state shelving.
Aug 16 15:47:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance destroyed successfully.
Aug 16 15:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:47:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:47:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance destroyed successfully.
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'resources' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948095263',display_name='tempest-TestShelveInstance-server-1948095263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948095263',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihfTlhnhDkN/KZnJC/NJJfdexVXZa6uxNr1ED8N594gkZvEkDP0KUUc92/ocYPc3K95+Rn/HxJGPMuT35bIxFBYlNG5IEi+6txd5qH/rVXDyPbozG4n3TIm3BxzocYzA==',key_name='tempest-TestShelveInstance-1280995366',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bc952ced574166b16e806db3c7f10c',ramdisk_id='',reservation_id='r-cugooytk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-908151640',owner_user_name='tempest-TestShelveInstance-908151640-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:45:40Z,user_data=None,user_id='6a9c0ba18b7742868de0162a427d517d',uuid=b7ead4ad-e491-4d98-81d6-355ac42ef0fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converting VIF {"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_vif [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap515219ba-2d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:47:18 user nova-compute[73091]: INFO os_vif [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d')
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:47:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cf20c-7dff-43cb-ad09-6c9ef967149a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[330594e8-d5c2-4a29-aa13-ddd4c53465a0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:47:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:47:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c578af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc4905-f081-485a-863e-0d2c17387b97]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6985e8-54e0-4bdd-b5ea-1ed0afe898d6]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c54292-f31c-4d45-8804-72ce038c58dd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18610137-ba95-4310-84bb-349e4fd2092d]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4ac3f3-3ac4-4401-99f0-7e2a60e8c18b]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa94d45-09d4-4815-9512-3bbdc1b47399]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]
Aug 16 15:47:18 user nova-compute[73091]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.
Aug 16 15:47:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6f061e-c1fd-4616-97c6-062b868cade4]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] <== disconnect_volume: return (245ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:47:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:47:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Deleting instance files /opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe_del
Aug 16 15:47:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Deletion of /opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe_del complete
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:47:19 user nova-compute[73091]: WARNING nova.compute.manager [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state active and task_state shelving.
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing instance network info cache due to event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated VIF entry in instance network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": null, "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap515219ba-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09a7a815-be84-4bdd-b90e-4b62f57f3fa7 req-9f73411a-9f0a-451b-9d9b-e5d8bbbfcc54 service nova] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:47:19 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Deleted allocations for instance b7ead4ad-e491-4d98-81d6-355ac42ef0fe
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'numa_topology' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:47:19 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:47:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.100s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac06b85c-d168-4bf5-a54a-ec9947166eca tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.293s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:47:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:32 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692200837.7007024, b7ead4ad-e491-4d98-81d6-355ac42ef0fe => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:47:32 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] VM Stopped (Lifecycle Event)
Aug 16 15:47:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c6f63ac5-b896-4193-93c8-5c5fe9d0861d None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:47:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:47:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:47:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:47:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.2725830078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:47:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:47:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:47:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:47:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:47:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:47:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:47:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:48:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:48:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:48:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:48:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:48:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.27206039428711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:43 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:48:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:48:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:48:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:48:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:48:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:48:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:48:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:48:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:49:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:08 user nova-compute[73091]: INFO nova.compute.manager [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Unshelving
Aug 16 15:49:08 user nova-compute[73091]: INFO nova.virt.block_device [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Booting with volume 6a073dc8-a61e-4837-82ad-e9060406b5cb at /dev/vda
Aug 16 15:49:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2641285d-9964-41f1-8109-661452767e6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c942b68-72ad-4f1e-abed-88ae1a7dd249]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6708db-e29b-409b-8015-a08831539409]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723234f-b4c2-4f5b-b92e-e5318a3a80e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:49:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:49:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a417e42c-2b5e-4d6f-8215-a2bc39d4eb64]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating existing volume attachment record: 7a2a2805-11fc-48c9-bd47-1669d970a5f5 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:49:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:49:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:49:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:49:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:49:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:49:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:49:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:49:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:49:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:49:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'pci_requests' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:49:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'numa_topology' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:49:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:49:24 user nova-compute[73091]: INFO nova.compute.claims [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Claim successful on node user
Aug 16 15:49:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:49:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:49:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:25 user nova-compute[73091]: INFO nova.network.neutron [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating port 515219ba-2ddc-4398-8647-489f3eed8d15 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 15:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing instance network info cache due to event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:49:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Creating image(s)
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Ensure instance console log exists: /opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Start _get_guest_xml network_info=[{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '7a2a2805-11fc-48c9-bd47-1669d970a5f5', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7ead4ad-e491-4d98-81d6-355ac42ef0fe', 'attached_at': '', 'detached_at': '', 'volume_id': '6a073dc8-a61e-4837-82ad-e9060406b5cb', 'serial': '6a073dc8-a61e-4837-82ad-e9060406b5cb'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:49:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:49:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:49:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:49:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:49:26 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229e40b-28a7-47a6-a989-7e914d5384b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:49:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa438189-b26e-4136-a2a3-161b0ad0b9df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb] added
Aug 16 15:49:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7666284-6e66-4681-a0f2-6e0a4bd420fd]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b1a92c-6d96-457b-bfb9-6f637f6a8111]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCVMalSs {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCVMalSs" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7d1d86-0f18-4342-a80a-e29ade447ecc]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCVMalSs'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac7ab0-a436-4979-bd6f-48e676d6dcaa]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e2d73-9721-4e09-94e6-d85f834d02f7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:49:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:49:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:49:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:49:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:49:26 user nova-compute[73091]: 
Aug 16 15:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c1fa2-32cb-46fe-9268-19e3a0cc3abc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]
Aug 16 15:49:27 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.
Aug 16 15:49:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec39bf8c-6c8d-49b5-bb40-98f48d68a6f3]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d7f8f4-9d38-4932-8630-6ee0d0fddd8d]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:49:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:49:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53acfc-63a1-4317-abf8-d3163d6cb181]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated VIF entry in instance network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:49:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-99c0bb0c-ef8c-4dea-a2f0-4dcd5367727f req-f4a32afd-33cf-453d-bdd5-d7da4b843b19 service nova] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23631346262346132', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346262346132', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948095263',display_name='tempest-TestShelveInstance-server-1948095263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948095263',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1280995366',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5bc952ced574166b16e806db3c7f10c',ramdisk_id='',reservation_id='r-cugooytk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-908151640',owner_user_name='tempest-TestShelveInstance-908151640-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:49:08Z,user_data=None,user_id='6a9c0ba18b7742868de0162a427d517d',uuid=b7ead4ad-e491-4d98-81d6-355ac42ef0fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converting VIF {"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'pci_devices' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:49:28 user nova-compute[73091]:   <uuid>b7ead4ad-e491-4d98-81d6-355ac42ef0fe</uuid>
Aug 16 15:49:28 user nova-compute[73091]:   <name>instance-00000034</name>
Aug 16 15:49:28 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:49:28 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:49:28 user nova-compute[73091]:   <metadata>
Aug 16 15:49:28 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:49:28 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:49:28 user nova-compute[73091]:       <nova:name>tempest-TestShelveInstance-server-1948095263</nova:name>
Aug 16 15:49:28 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:49:26</nova:creationTime>
Aug 16 15:49:28 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:49:28 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:49:28 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:49:28 user nova-compute[73091]:       <nova:owner>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:user uuid="6a9c0ba18b7742868de0162a427d517d">tempest-TestShelveInstance-908151640-project-member</nova:user>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:project uuid="d5bc952ced574166b16e806db3c7f10c">tempest-TestShelveInstance-908151640</nova:project>
Aug 16 15:49:28 user nova-compute[73091]:       </nova:owner>
Aug 16 15:49:28 user nova-compute[73091]:       <nova:ports>
Aug 16 15:49:28 user nova-compute[73091]:         <nova:port uuid="515219ba-2ddc-4398-8647-489f3eed8d15">
Aug 16 15:49:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 15:49:28 user nova-compute[73091]:         </nova:port>
Aug 16 15:49:28 user nova-compute[73091]:       </nova:ports>
Aug 16 15:49:28 user nova-compute[73091]:     </nova:instance>
Aug 16 15:49:28 user nova-compute[73091]:   </metadata>
Aug 16 15:49:28 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:49:28 user nova-compute[73091]:     <system>
Aug 16 15:49:28 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:49:28 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:49:28 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:49:28 user nova-compute[73091]:       <entry name="serial">b7ead4ad-e491-4d98-81d6-355ac42ef0fe</entry>
Aug 16 15:49:28 user nova-compute[73091]:       <entry name="uuid">b7ead4ad-e491-4d98-81d6-355ac42ef0fe</entry>
Aug 16 15:49:28 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:49:28 user nova-compute[73091]:     </system>
Aug 16 15:49:28 user nova-compute[73091]:   </sysinfo>
Aug 16 15:49:28 user nova-compute[73091]:   <os>
Aug 16 15:49:28 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:49:28 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:49:28 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:49:28 user nova-compute[73091]:   </os>
Aug 16 15:49:28 user nova-compute[73091]:   <features>
Aug 16 15:49:28 user nova-compute[73091]:     <acpi/>
Aug 16 15:49:28 user nova-compute[73091]:     <apic/>
Aug 16 15:49:28 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:49:28 user nova-compute[73091]:   </features>
Aug 16 15:49:28 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:49:28 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:49:28 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:49:28 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:49:28 user nova-compute[73091]:   </clock>
Aug 16 15:49:28 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:49:28 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:49:28 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:49:28 user nova-compute[73091]:   </cpu>
Aug 16 15:49:28 user nova-compute[73091]:   <devices>
Aug 16 15:49:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 15:49:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:49:28 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 15:49:28 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:49:28 user nova-compute[73091]:       <serial>6a073dc8-a61e-4837-82ad-e9060406b5cb</serial>
Aug 16 15:49:28 user nova-compute[73091]:     </disk>
Aug 16 15:49:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:49:28 user nova-compute[73091]:       <mac address="fa:16:3e:67:18:02"/>
Aug 16 15:49:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:49:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:49:28 user nova-compute[73091]:       <target dev="tap515219ba-2d"/>
Aug 16 15:49:28 user nova-compute[73091]:     </interface>
Aug 16 15:49:28 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:49:28 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe/console.log" append="off"/>
Aug 16 15:49:28 user nova-compute[73091]:     </serial>
Aug 16 15:49:28 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:49:28 user nova-compute[73091]:     <video>
Aug 16 15:49:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:49:28 user nova-compute[73091]:     </video>
Aug 16 15:49:28 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:49:28 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:49:28 user nova-compute[73091]:     </rng>
Aug 16 15:49:28 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:49:28 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:49:28 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:49:28 user nova-compute[73091]:     </memballoon>
Aug 16 15:49:28 user nova-compute[73091]:   </devices>
Aug 16 15:49:28 user nova-compute[73091]: </domain>
Aug 16 15:49:28 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948095263',display_name='tempest-TestShelveInstance-server-1948095263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948095263',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1280995366',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5bc952ced574166b16e806db3c7f10c',ramdisk_id='',reservation_id='r-cugooytk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-908151640',owner_user_name='tempest-TestShelveInstance-908151640-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:49:08Z,user_data=None,user_id='6a9c0ba18b7742868de0162a427d517d',uuid=b7ead4ad-e491-4d98-81d6-355ac42ef0fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converting VIF {"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG os_vif [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap515219ba-2d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap515219ba-2d, col_values=(('external_ids', {'iface-id': '515219ba-2ddc-4398-8647-489f3eed8d15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:18:02', 'vm-uuid': 'b7ead4ad-e491-4d98-81d6-355ac42ef0fe'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:28 user nova-compute[73091]: INFO os_vif [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d')
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:49:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] No VIF found with MAC fa:16:3e:67:18:02, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-72b8c2fa-aec5-43f7-9ace-553d77208391 req-d27cd0f9-4338-40f0-a97d-e87fea3b80ea service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-72b8c2fa-aec5-43f7-9ace-553d77208391 req-d27cd0f9-4338-40f0-a97d-e87fea3b80ea service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-72b8c2fa-aec5-43f7-9ace-553d77208391 req-d27cd0f9-4338-40f0-a97d-e87fea3b80ea service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-72b8c2fa-aec5-43f7-9ace-553d77208391 req-d27cd0f9-4338-40f0-a97d-e87fea3b80ea service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-72b8c2fa-aec5-43f7-9ace-553d77208391 req-d27cd0f9-4338-40f0-a97d-e87fea3b80ea service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:49:29 user nova-compute[73091]: WARNING nova.compute.manager [req-72b8c2fa-aec5-43f7-9ace-553d77208391 req-d27cd0f9-4338-40f0-a97d-e87fea3b80ea service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 15:49:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200971.5102713, b7ead4ad-e491-4d98-81d6-355ac42ef0fe => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:49:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] VM Resumed (Lifecycle Event)
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:49:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance spawned successfully.
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:49:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692200971.5123973, b7ead4ad-e491-4d98-81d6-355ac42ef0fe => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:49:31 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] VM Started (Lifecycle Event)
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8942a15-db2f-4dcc-8bf0-fa7c75c76e6b tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.315s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-dd8e24e3-c111-4019-a6bd-15b5cf3922b2 req-45fc21a4-c94e-48cc-a308-b2c8e9de5d26 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dd8e24e3-c111-4019-a6bd-15b5cf3922b2 req-45fc21a4-c94e-48cc-a308-b2c8e9de5d26 service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dd8e24e3-c111-4019-a6bd-15b5cf3922b2 req-45fc21a4-c94e-48cc-a308-b2c8e9de5d26 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dd8e24e3-c111-4019-a6bd-15b5cf3922b2 req-45fc21a4-c94e-48cc-a308-b2c8e9de5d26 service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-dd8e24e3-c111-4019-a6bd-15b5cf3922b2 req-45fc21a4-c94e-48cc-a308-b2c8e9de5d26 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:49:31 user nova-compute[73091]: WARNING nova.compute.manager [req-dd8e24e3-c111-4019-a6bd-15b5cf3922b2 req-45fc21a4-c94e-48cc-a308-b2c8e9de5d26 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state active and task_state None.
Aug 16 15:49:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:49:44 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:49:44 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:49:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.27056884765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7ead4ad-e491-4d98-81d6-355ac42ef0fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:49:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:49:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:49:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:49:45 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:49:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:49:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:49:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:49:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:50:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:50:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:50:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:50:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:50:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:50:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:50:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:50:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:50:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.269935607910156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance b7ead4ad-e491-4d98-81d6-355ac42ef0fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:50:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:50:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:50:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:50:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:50:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:50:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing instance network info cache due to event network-changed-515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] Acquiring lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] Acquired lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Refreshing network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:50:59 user nova-compute[73091]: INFO nova.compute.manager [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Terminating instance
Aug 16 15:50:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:50:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Instance destroyed successfully.
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lazy-loading 'resources' on Instance uuid b7ead4ad-e491-4d98-81d6-355ac42ef0fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T15:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948095263',display_name='tempest-TestShelveInstance-server-1948095263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948095263',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihfTlhnhDkN/KZnJC/NJJfdexVXZa6uxNr1ED8N594gkZvEkDP0KUUc92/ocYPc3K95+Rn/HxJGPMuT35bIxFBYlNG5IEi+6txd5qH/rVXDyPbozG4n3TIm3BxzocYzA==',key_name='tempest-TestShelveInstance-1280995366',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bc952ced574166b16e806db3c7f10c',ramdisk_id='',reservation_id='r-cugooytk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-908151640',owner_user_name='tempest-TestShelveInstance-908151640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:49:32Z,user_data=None,user_id='6a9c0ba18b7742868de0162a427d517d',uuid=b7ead4ad-e491-4d98-81d6-355ac42ef0fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converting VIF {"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_vif [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap515219ba-2d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:51:00 user nova-compute[73091]: INFO os_vif [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:18:02,bridge_name='br-int',has_traffic_filtering=True,id=515219ba-2ddc-4398-8647-489f3eed8d15,network=Network(39a0c502-6905-4434-b02d-dbff764f01ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap515219ba-2d')
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCVMalSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:51:00 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[517956d8-6dec-4b66-80eb-e36e16a71f7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbeccb0-213a-40bf-b87e-41f0823e1435]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:51:00 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb (non-flash)
Aug 16 15:51:00 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c579480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da07876-51b0-4460-90ed-ca001f8b1654]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a377bc-311b-47cf-9438-d224ec0d2a78]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4484266-631e-454a-9bf2-b69952184a0a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updated VIF entry in instance network info cache for port 515219ba-2ddc-4398-8647-489f3eed8d15. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [{"id": "515219ba-2ddc-4398-8647-489f3eed8d15", "address": "fa:16:3e:67:18:02", "network": {"id": "39a0c502-6905-4434-b02d-dbff764f01ec", "bridge": "br-int", "label": "tempest-TestShelveInstance-1875054996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bc952ced574166b16e806db3c7f10c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap515219ba-2d", "ovs_interfaceid": "515219ba-2ddc-4398-8647-489f3eed8d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d9b21b9-5cd9-4195-8a68-d5bd5ee92079 req-08425db4-bde5-412e-a676-09ecfe2c1ca2 service nova] Releasing lock "refresh_cache-b7ead4ad-e491-4d98-81d6-355ac42ef0fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f80c8-c4c6-4368-8651-5ef4af9f0abb]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcb883abf-614bb4a2ff7064e1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cb883abf', '/dev/disk/by-id/scsi-23631346262346132') {{(pid=84412) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee6540b-49df-4913-b846-3365fee427d1]: (4, None) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae2338d-857e-48cd-a9e9-4ff22cd6e150]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d07c4-2441-42d4-9128-5a152b9cd61e]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260]
Aug 16 15:51:00 user nova-compute[73091]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb, portal: 172.16.0.220,3260] successful.
Aug 16 15:51:00 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a073dc8-a61e-4837-82ad-e9060406b5cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f326f-c680-4632-9dfb-1f6b26762d44]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] <== disconnect_volume: return (286ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:51:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Deleting instance files /opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe_del
Aug 16 15:51:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Deletion of /opt/stack/data/nova/instances/b7ead4ad-e491-4d98-81d6-355ac42ef0fe_del complete
Aug 16 15:51:00 user nova-compute[73091]: INFO nova.compute.manager [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 15:51:00 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 15:51:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:51:00 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Took 0.43 seconds to deallocate network for instance.
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-unplugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-unplugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-unplugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] Acquiring lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] No waiting events found dispatching network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:51:01 user nova-compute[73091]: WARNING nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received unexpected event network-vif-plugged-515219ba-2ddc-4398-8647-489f3eed8d15 for instance with vm_state active and task_state deleting.
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef1a1e8c-c731-4e51-a7c0-3a56f7c5c2b1 req-b0e1fc90-28c3-4ff9-a6af-f1bb5d16065d service nova] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Received event network-vif-deleted-515219ba-2ddc-4398-8647-489f3eed8d15 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:01 user nova-compute[73091]: INFO nova.compute.manager [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Deleting volume: 6a073dc8-a61e-4837-82ad-e9060406b5cb {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:51:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:51:01 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Deleted allocations for instance b7ead4ad-e491-4d98-81d6-355ac42ef0fe
Aug 16 15:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17704c29-eb5a-4b7a-bfb2-2611744631d7 tempest-TestShelveInstance-908151640 tempest-TestShelveInstance-908151640-project-member] Lock "b7ead4ad-e491-4d98-81d6-355ac42ef0fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:51:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692201060.0754478, b7ead4ad-e491-4d98-81d6-355ac42ef0fe => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:51:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] VM Stopped (Lifecycle Event)
Aug 16 15:51:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ef249866-270c-450f-9351-505abb2649da None None] [instance: b7ead4ad-e491-4d98-81d6-355ac42ef0fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:51:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:51:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:51:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:51:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:51:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:51:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.269149780273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:51:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:51:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 15:51:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:51:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:51:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:51:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:51:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:51:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:51:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:52:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 15:52:43 user nova-compute[73091]: INFO nova.compute.claims [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Claim successful on node user
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 15:52:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 15:52:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Creating image(s)
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "/opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "/opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG nova.policy [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e0810f5febe41f7bbe87ebf1302c1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb38f33da6432bac9b014e2156c190', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 15:52:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a,backing_fmt=raw /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk 1073741824" returned: 0 in 0.064s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "d8e952ce1c353ed9eab9b871a33d1969d35e882a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e952ce1c353ed9eab9b871a33d1969d35e882a --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Cannot resize image /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'migration_context' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Ensure instance console log exists: /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Successfully created port: 630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Successfully updated port: 630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-changed-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Refreshing instance network info cache due to event network-changed-630f694b-0775-4437-8674-1e35c2c12e8f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:52:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Instance network_info: |[{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Refreshing network info cache for port 630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Start _get_guest_xml network_info=[{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b18d278d-2e25-4ef6-ba90-d1af21f699be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 15:52:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:52:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T14:56:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T14:56:24Z,direct_url=<?>,disk_format='qcow2',id=b18d278d-2e25-4ef6-ba90-d1af21f699be,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='aa21f859d9f845088f11b1cc8fa21131',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T14:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-917230872',display_name='tempest-SnapshotDataIntegrityTests-server-917230872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-917230872',id=53,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYuYHVuK7uQjentA3IcK6aaU1umex+kONhlnoWjSjbbEBPs0G7fOfNDkbNujC4xuy2bmzWyArGaMpus+Eo1bLAImFikV+QG6JaPyNtI7X66kKgxh6h3zZ0CblqEG7EppA==',key_name='tempest-keypair-1950980076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0bb38f33da6432bac9b014e2156c190',ramdisk_id='',reservation_id='r-f9qkui2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-350461724',owner_user_name='tempest-SnapshotDataIntegrityTests-350461724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e0810f5febe41f7bbe87ebf1302c1ac',uuid=c0560206-b5f2-4b0e-80fd-d75b570f9c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Converting VIF {"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'pci_devices' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] End _get_guest_xml xml=<domain type="kvm">
Aug 16 15:52:46 user nova-compute[73091]:   <uuid>c0560206-b5f2-4b0e-80fd-d75b570f9c60</uuid>
Aug 16 15:52:46 user nova-compute[73091]:   <name>instance-00000035</name>
Aug 16 15:52:46 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 15:52:46 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 15:52:46 user nova-compute[73091]:   <metadata>
Aug 16 15:52:46 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 15:52:46 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 15:52:46 user nova-compute[73091]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-917230872</nova:name>
Aug 16 15:52:46 user nova-compute[73091]:       <nova:creationTime>2023-08-16 15:52:46</nova:creationTime>
Aug 16 15:52:46 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 15:52:46 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 15:52:46 user nova-compute[73091]:       </nova:flavor>
Aug 16 15:52:46 user nova-compute[73091]:       <nova:owner>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:user uuid="0e0810f5febe41f7bbe87ebf1302c1ac">tempest-SnapshotDataIntegrityTests-350461724-project-member</nova:user>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:project uuid="b0bb38f33da6432bac9b014e2156c190">tempest-SnapshotDataIntegrityTests-350461724</nova:project>
Aug 16 15:52:46 user nova-compute[73091]:       </nova:owner>
Aug 16 15:52:46 user nova-compute[73091]:       <nova:root type="image" uuid="b18d278d-2e25-4ef6-ba90-d1af21f699be"/>
Aug 16 15:52:46 user nova-compute[73091]:       <nova:ports>
Aug 16 15:52:46 user nova-compute[73091]:         <nova:port uuid="630f694b-0775-4437-8674-1e35c2c12e8f">
Aug 16 15:52:46 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 15:52:46 user nova-compute[73091]:         </nova:port>
Aug 16 15:52:46 user nova-compute[73091]:       </nova:ports>
Aug 16 15:52:46 user nova-compute[73091]:     </nova:instance>
Aug 16 15:52:46 user nova-compute[73091]:   </metadata>
Aug 16 15:52:46 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 15:52:46 user nova-compute[73091]:     <system>
Aug 16 15:52:46 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 15:52:46 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 15:52:46 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 15:52:46 user nova-compute[73091]:       <entry name="serial">c0560206-b5f2-4b0e-80fd-d75b570f9c60</entry>
Aug 16 15:52:46 user nova-compute[73091]:       <entry name="uuid">c0560206-b5f2-4b0e-80fd-d75b570f9c60</entry>
Aug 16 15:52:46 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 15:52:46 user nova-compute[73091]:     </system>
Aug 16 15:52:46 user nova-compute[73091]:   </sysinfo>
Aug 16 15:52:46 user nova-compute[73091]:   <os>
Aug 16 15:52:46 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 15:52:46 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 15:52:46 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 15:52:46 user nova-compute[73091]:   </os>
Aug 16 15:52:46 user nova-compute[73091]:   <features>
Aug 16 15:52:46 user nova-compute[73091]:     <acpi/>
Aug 16 15:52:46 user nova-compute[73091]:     <apic/>
Aug 16 15:52:46 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 15:52:46 user nova-compute[73091]:   </features>
Aug 16 15:52:46 user nova-compute[73091]:   <clock offset="utc">
Aug 16 15:52:46 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 15:52:46 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 15:52:46 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 15:52:46 user nova-compute[73091]:   </clock>
Aug 16 15:52:46 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 15:52:46 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 15:52:46 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 15:52:46 user nova-compute[73091]:   </cpu>
Aug 16 15:52:46 user nova-compute[73091]:   <devices>
Aug 16 15:52:46 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 15:52:46 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 15:52:46 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk"/>
Aug 16 15:52:46 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 15:52:46 user nova-compute[73091]:     </disk>
Aug 16 15:52:46 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 15:52:46 user nova-compute[73091]:       <mac address="fa:16:3e:fc:11:61"/>
Aug 16 15:52:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:52:46 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 15:52:46 user nova-compute[73091]:       <target dev="tap630f694b-07"/>
Aug 16 15:52:46 user nova-compute[73091]:     </interface>
Aug 16 15:52:46 user nova-compute[73091]:     <serial type="pty">
Aug 16 15:52:46 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/console.log" append="off"/>
Aug 16 15:52:46 user nova-compute[73091]:     </serial>
Aug 16 15:52:46 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 15:52:46 user nova-compute[73091]:     <video>
Aug 16 15:52:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 15:52:46 user nova-compute[73091]:     </video>
Aug 16 15:52:46 user nova-compute[73091]:     <rng model="virtio">
Aug 16 15:52:46 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 15:52:46 user nova-compute[73091]:     </rng>
Aug 16 15:52:46 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 15:52:46 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 15:52:46 user nova-compute[73091]:       <stats period="10"/>
Aug 16 15:52:46 user nova-compute[73091]:     </memballoon>
Aug 16 15:52:46 user nova-compute[73091]:   </devices>
Aug 16 15:52:46 user nova-compute[73091]: </domain>
Aug 16 15:52:46 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-917230872',display_name='tempest-SnapshotDataIntegrityTests-server-917230872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-917230872',id=53,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYuYHVuK7uQjentA3IcK6aaU1umex+kONhlnoWjSjbbEBPs0G7fOfNDkbNujC4xuy2bmzWyArGaMpus+Eo1bLAImFikV+QG6JaPyNtI7X66kKgxh6h3zZ0CblqEG7EppA==',key_name='tempest-keypair-1950980076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0bb38f33da6432bac9b014e2156c190',ramdisk_id='',reservation_id='r-f9qkui2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-350461724',owner_user_name='tempest-SnapshotDataIntegrityTests-350461724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T15:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e0810f5febe41f7bbe87ebf1302c1ac',uuid=c0560206-b5f2-4b0e-80fd-d75b570f9c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Converting VIF {"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG os_vif [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap630f694b-07, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap630f694b-07, col_values=(('external_ids', {'iface-id': '630f694b-0775-4437-8674-1e35c2c12e8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:11:61', 'vm-uuid': 'c0560206-b5f2-4b0e-80fd-d75b570f9c60'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:46 user nova-compute[73091]: INFO os_vif [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07')
Aug 16 15:52:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No VIF found with MAC fa:16:3e:fc:11:61, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated VIF entry in instance network info cache for port 630f694b-0775-4437-8674-1e35c2c12e8f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:52:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-055c652e-0d6b-46d4-ab99-0079acde91a3 req-5351284b-89d5-4fda-a66c-84fc4f96f884 service nova] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-7b18bc32-5319-461f-a782-83daa03cf593 req-867e97e9-6382-431e-9b1d-c605203feb25 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7b18bc32-5319-461f-a782-83daa03cf593 req-867e97e9-6382-431e-9b1d-c605203feb25 service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7b18bc32-5319-461f-a782-83daa03cf593 req-867e97e9-6382-431e-9b1d-c605203feb25 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7b18bc32-5319-461f-a782-83daa03cf593 req-867e97e9-6382-431e-9b1d-c605203feb25 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-7b18bc32-5319-461f-a782-83daa03cf593 req-867e97e9-6382-431e-9b1d-c605203feb25 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:52:48 user nova-compute[73091]: WARNING nova.compute.manager [req-7b18bc32-5319-461f-a782-83daa03cf593 req-867e97e9-6382-431e-9b1d-c605203feb25 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received unexpected event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with vm_state building and task_state spawning.
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:52:49 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:52:49 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=25.25444793701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:52:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-00933dbb-7e8d-40c8-ba74-6063ee7b10c9 req-2c5961b7-74e4-4b4a-81a3-4fcf47a82e2f service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00933dbb-7e8d-40c8-ba74-6063ee7b10c9 req-2c5961b7-74e4-4b4a-81a3-4fcf47a82e2f service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00933dbb-7e8d-40c8-ba74-6063ee7b10c9 req-2c5961b7-74e4-4b4a-81a3-4fcf47a82e2f service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00933dbb-7e8d-40c8-ba74-6063ee7b10c9 req-2c5961b7-74e4-4b4a-81a3-4fcf47a82e2f service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-00933dbb-7e8d-40c8-ba74-6063ee7b10c9 req-2c5961b7-74e4-4b4a-81a3-4fcf47a82e2f service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 15:52:50 user nova-compute[73091]: WARNING nova.compute.manager [req-00933dbb-7e8d-40c8-ba74-6063ee7b10c9 req-2c5961b7-74e4-4b4a-81a3-4fcf47a82e2f service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received unexpected event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with vm_state building and task_state spawning.
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692201170.530589, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] VM Resumed (Lifecycle Event)
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Instance spawned successfully.
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.virt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Emitting event <LifecycleEvent: 1692201170.5324237, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] VM Started (Lifecycle Event)
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 16 15:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 15:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Took 7.52 seconds to build instance.
Aug 16 15:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-84925ae5-531b-4e1a-9b29-2edfd5b62cd1 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.652s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:52:51 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:52:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:52:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:52:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:52:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:52:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:52:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:53:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:53:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:53:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.22254180908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:53:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:53:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:53:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:53:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:53:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:53:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:53:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:53:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:54:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:54:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:54:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:54:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:54:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-changed-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Refreshing instance network info cache due to event network-changed-630f694b-0775-4437-8674-1e35c2c12e8f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Refreshing network info cache for port 630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated VIF entry in instance network info cache for port 630f694b-0775-4437-8674-1e35c2c12e8f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:54:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f4207158-d5fe-4d56-b248-fe419bfb1842 req-88818c05-f5ef-43bf-b8b1-6bbff5174c81 service nova] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:54:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:54:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:54:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:54:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:54:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:54:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:54:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:54:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:54:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:54:40 user nova-compute[73091]: INFO nova.compute.manager [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attaching volume 3aa5cfff-cff2-4e00-b8af-ba881da75ad7 to /dev/vdb
Aug 16 15:54:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5062712-1499-4e94-818a-df4c991efdb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd00100e-9c1b-4a2d-9451-9e217e572c6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63af2364-edbd-47ad-8be2-cee910d9ffd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3c436-3d6c-4c31-9840-91626ff46402]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:54:40 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:54:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223d6bb-1112-4a66-9711-4d78e3046c2d]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:54:40 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating existing volume attachment record: 66304d41-eeae-47dc-8a85-84f9d12ffe82 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:54:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liITOFLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:54:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:54:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:54:49 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9743277a-7505-45df-bf6a-a8a50f80cc65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:54:49 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a682fb6-3d04-49f2-b544-0f9f75403270]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7] added
Aug 16 15:54:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac27b53-0cc5-4d23-a136-8b6a419e05ea]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48ebe66-50d5-4e99-abb9-943657888c22]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liITOFLD {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liITOFLD" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c03db6e-485f-449e-b870-d9eb0dbdf2e7]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liITOFLD'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaeeee4-82f6-4449-bf0e-2c87309bd051]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ce3f2f-28e8-4857-97e8-936ff179eb96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:54:50 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:54:50 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:54:50 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:54:50 user nova-compute[73091]: 
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a7887f-168b-4a23-ba05-792d66f07d07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260]
Aug 16 15:54:50 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260] successful.
Aug 16 15:54:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcac3e-ba2b-4176-a70a-af2825ccadae]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[561bc5a4-23b6-4393-b728-337c6719cb46]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 (non-flash)
Aug 16 15:54:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 (non-flash)
Aug 16 15:54:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dd44b7-bbb0-4a98-8457-bdcd94001a3d]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:54:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liITOFLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23030326539373438', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030326539373438', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.objects.instance [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:54:51 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:54:51 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:54:51 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:54:51 user nova-compute[73091]:   <serial>3aa5cfff-cff2-4e00-b8af-ba881da75ad7</serial>
Aug 16 15:54:51 user nova-compute[73091]: </disk>
Aug 16 15:54:51 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No VIF found with MAC fa:16:3e:fc:11:61, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-60544969-772a-4f6f-a7ac-c0b4aa25cee8 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.708s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:54:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 15:54:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:54:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.221195220947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:54:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:54:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:54:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:54:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:54:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:54:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:54:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:54:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:54:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:54:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:55:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:55:19 user nova-compute[73091]: INFO nova.compute.manager [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Detaching volume 3aa5cfff-cff2-4e00-b8af-ba881da75ad7
Aug 16 15:55:19 user nova-compute[73091]: INFO nova.virt.block_device [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attempting to driver detach volume 3aa5cfff-cff2-4e00-b8af-ba881da75ad7 from mountpoint /dev/vdb
Aug 16 15:55:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Attempting to detach device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:55:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:55:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:55:19 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:55:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:55:19 user nova-compute[73091]:   <serial>3aa5cfff-cff2-4e00-b8af-ba881da75ad7</serial>
Aug 16 15:55:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:55:19 user nova-compute[73091]: </disk>
Aug 16 15:55:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:55:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config.
Aug 16 15:55:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:55:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:55:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:55:19 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:55:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:55:19 user nova-compute[73091]:   <serial>3aa5cfff-cff2-4e00-b8af-ba881da75ad7</serial>
Aug 16 15:55:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:55:19 user nova-compute[73091]: </disk>
Aug 16 15:55:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692201320.3982308, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:55:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config.
Aug 16 15:55:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liITOFLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:55:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a248d-d937-4064-ac1b-3180ba2af180]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb4d3d-3e32-4b14-953f-46cef2dd9366]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 (non-flash)
Aug 16 15:55:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 (non-flash)
Aug 16 15:55:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c55fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97871d23-8805-4829-a5dd-76ef8b0d3f0f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba1edd-ef77-446c-b2e3-0e2b595c78ad]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4dff4-476c-45e2-a2eb-e5419d072bf8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91187460-4806-4ebc-b001-082d3c85fd45]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb8205f-14d2-4236-acc2-caa3ccb8dc55]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef83fc-e674-4cc8-8564-2a09b770b236]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260]
Aug 16 15:55:20 user nova-compute[73091]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7, portal: 172.16.0.220,3260] successful.
Aug 16 15:55:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa5cfff-cff2-4e00-b8af-ba881da75ad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[047f256b-f083-4870-bb4a-194b5118d787]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== disconnect_volume: return (263ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:55:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-231ad932-a0ea-451d-94ab-02b7b63017d2 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:55:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:55:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:55:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.212337493896484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:55:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:55:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:55:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:55:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:55:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:55:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:55:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:56:14 user nova-compute[73091]: INFO nova.compute.manager [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attaching volume b2dd2381-d994-49c9-b58f-c7a344ea9a4f to /dev/vdb
Aug 16 15:56:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d54b8-efa9-42c3-a726-232c3cf447e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46608977-a69a-45c3-85d4-0477f7d8c443]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9688b663-d84e-4861-af98-c177bea0873b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c299129f-73f0-4fa2-9bd3-e86dbe9e6243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:56:14 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:56:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8690b411-070b-403e-b43b-b2ad979a6a7b]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:56:14 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating existing volume attachment record: fc26d767-55a8-4bd5-86c7-f72be116464b {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:56:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfTBnyvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:56:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:56:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:56:24 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb96162-fa4b-4545-bb3a-f9b7319353a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:56:24 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eba73f-96d6-4dd9-871a-7126dd867f4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f] added
Aug 16 15:56:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03d929-3972-442d-96fe-a64442fe3700]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9baf3c4-d470-4834-970e-fcceed149504]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfTBnyvE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfTBnyvE" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6fd3b4-e6e1-4b3a-b2d7-5ebd8dcfec78]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfTBnyvE'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f1bc2-e3cb-4660-96d8-81aa95039b3a]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b8e11c-e3e9-45a1-81c5-ad3a26816a5d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:56:24 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:56:24 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:56:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:56:24 user nova-compute[73091]: 
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f3bf88-7335-49af-a3aa-7cf15545a690]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260]
Aug 16 15:56:24 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260] successful.
Aug 16 15:56:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26950b1e-dd89-481b-b7c3-c7deef768fe9]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0855dfa-b74e-472d-95ed-23571b85aabe]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f (non-flash)
Aug 16 15:56:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f (non-flash)
Aug 16 15:56:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07af26dd-f439-4878-a70b-491e81fe192e]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:56:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfTBnyvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23638646561303662', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638646561303662', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:56:25 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:56:25 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:56:25 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:56:25 user nova-compute[73091]:   <serial>b2dd2381-d994-49c9-b58f-c7a344ea9a4f</serial>
Aug 16 15:56:25 user nova-compute[73091]: </disk>
Aug 16 15:56:25 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No VIF found with MAC fa:16:3e:fc:11:61, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:56:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fe31c47d-f56c-4605-8fdb-dec0df3c80a3 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.730s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:56:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:56:28 user nova-compute[73091]: INFO nova.compute.manager [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Detaching volume b2dd2381-d994-49c9-b58f-c7a344ea9a4f
Aug 16 15:56:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attempting to driver detach volume b2dd2381-d994-49c9-b58f-c7a344ea9a4f from mountpoint /dev/vdb
Aug 16 15:56:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Attempting to detach device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:56:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:56:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:56:28 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:56:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:56:28 user nova-compute[73091]:   <serial>b2dd2381-d994-49c9-b58f-c7a344ea9a4f</serial>
Aug 16 15:56:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:56:28 user nova-compute[73091]: </disk>
Aug 16 15:56:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:56:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config.
Aug 16 15:56:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:56:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:56:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:56:28 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:56:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:56:28 user nova-compute[73091]:   <serial>b2dd2381-d994-49c9-b58f-c7a344ea9a4f</serial>
Aug 16 15:56:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:56:28 user nova-compute[73091]: </disk>
Aug 16 15:56:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692201389.2711604, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:56:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config.
Aug 16 15:56:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfTBnyvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:56:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5ad309-91bd-4597-b2e9-13380200fd78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[73599fb3-5c8a-4c23-a227-5dabc49bd0f7]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f (non-flash)
Aug 16 15:56:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f (non-flash)
Aug 16 15:56:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c54a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af5ffd2-b817-478b-b6ea-59d3a3cf9693]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0aff0e-3444-4b2a-a156-320a3df8b747]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b058dbaa-293e-48bd-99da-cb5f66a4dd16]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9c6d69-8617-4fdd-8d11-3763e0adc30a]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eeec1f-25b5-4881-8ac9-eaa4990ef518]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3068a1-0590-4139-93c9-1697df2a590f]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260]
Aug 16 15:56:29 user nova-compute[73091]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f, portal: 172.16.0.220,3260] successful.
Aug 16 15:56:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2dd2381-d994-49c9-b58f-c7a344ea9a4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eac23f-647c-4a52-a162-6984b24edde8]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== disconnect_volume: return (325ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:56:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:56:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:56:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-543e360e-9469-4975-bb4b-b8cc5b023b40 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.753s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:56:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:56:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:56:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:56:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.211334228515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing inventories for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating ProviderTree inventory for provider de22140b-6a80-4bc1-99c6-0964e3f024fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Updating inventory in ProviderTree for provider de22140b-6a80-4bc1-99c6-0964e3f024fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing aggregate associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Refreshing trait associations for resource provider de22140b-6a80-4bc1-99c6-0964e3f024fc, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:56:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:56:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:56:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:56:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:57:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 15:57:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 15:57:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 15:57:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:57:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:57:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:57:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:57:23 user nova-compute[73091]: INFO nova.compute.manager [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attaching volume bd086cac-21ca-412f-a777-fa9de0bc981c to /dev/vdb
Aug 16 15:57:23 user nova-compute[73091]: DEBUG os_brick.utils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51de1412-fd98-4e28-a3da-a6b04f7e05b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[08529b57-6a73-4677-a318-610f0d9c38b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[152c5720-a7fe-4cfe-81f4-a04f70e218d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8a74f-66ad-4afb-9bf7-7327fd074c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:57:23 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:57:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db83d1-7f61-4d20-82ee-6761001d12b0]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG os_brick.utils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:57:23 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating existing volume attachment record: d7f6588f-f1dd-4783-888c-950eeaf29109 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:57:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:57:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWEVLDbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:57:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:57:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:57:32 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[261c57cd-2d1f-4f43-a5f7-6b1616ed1b13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:57:32 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc31773-9b05-446b-89a1-3587ed1e1220]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c] added
Aug 16 15:57:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea1148f-8bd0-4f89-a64c-d65ce7070397]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d563b9-b6ef-42d7-b24a-a339d4f0a6d2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWEVLDbT {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWEVLDbT" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6436f-66da-483c-9f9d-5bc632a1f2c2]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OWEVLDbT'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f84a59a-3279-4faa-b777-cd3711f93847]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56dd4d-9af7-4afc-98bc-8ccba8879346]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:57:33 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:57:33 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:57:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:57:33 user nova-compute[73091]: 
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[919ef0dd-ecf3-4fc0-a8f0-7aea3342b585]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260]
Aug 16 15:57:33 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260] successful.
Aug 16 15:57:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e4499-361b-4fc3-b718-091cba93043d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b29f3-82f1-4e0a-8828-ed5f3efcaf30]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c (non-flash)
Aug 16 15:57:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c (non-flash)
Aug 16 15:57:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95f863-fd1e-43e7-b9d7-787601524ee5]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWEVLDbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26662613865363265', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662613865363265', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:57:34 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:57:34 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:57:34 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:57:34 user nova-compute[73091]:   <serial>bd086cac-21ca-412f-a777-fa9de0bc981c</serial>
Aug 16 15:57:34 user nova-compute[73091]: </disk>
Aug 16 15:57:34 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No VIF found with MAC fa:16:3e:fc:11:61, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:57:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f586afdd-0a18-4aa4-afd6-cfa08a807062 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.727s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:57:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:57:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:57:37 user nova-compute[73091]: INFO nova.compute.manager [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Detaching volume bd086cac-21ca-412f-a777-fa9de0bc981c
Aug 16 15:57:37 user nova-compute[73091]: INFO nova.virt.block_device [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attempting to driver detach volume bd086cac-21ca-412f-a777-fa9de0bc981c from mountpoint /dev/vdb
Aug 16 15:57:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Attempting to detach device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:57:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:57:37 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:57:37 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:57:37 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:57:37 user nova-compute[73091]:   <serial>bd086cac-21ca-412f-a777-fa9de0bc981c</serial>
Aug 16 15:57:37 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:57:37 user nova-compute[73091]: </disk>
Aug 16 15:57:37 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:57:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config.
Aug 16 15:57:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:57:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:57:37 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:57:37 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:57:37 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:57:37 user nova-compute[73091]:   <serial>bd086cac-21ca-412f-a777-fa9de0bc981c</serial>
Aug 16 15:57:37 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:57:37 user nova-compute[73091]: </disk>
Aug 16 15:57:37 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692201458.0216932, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:57:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config.
Aug 16 15:57:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWEVLDbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:57:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00909fc0-6a4e-4913-8afd-6813f2b729d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34920c8-0091-4508-965a-2f4fec050341]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c (non-flash)
Aug 16 15:57:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c (non-flash)
Aug 16 15:57:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1154250ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64da4d-8052-4891-9c76-ff9f8195783e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95be462-441a-4067-a41f-bfc3569a7e96]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aa1c14-3f52-462e-9e9f-06bcde64674e]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0060001-281c-4071-ac63-87e8906efa52]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cff94d-4eb3-4ac5-8570-859d4b4814cf]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de787691-932b-4842-835e-91fae2433295]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260]
Aug 16 15:57:38 user nova-compute[73091]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c, portal: 172.16.0.220,3260] successful.
Aug 16 15:57:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd086cac-21ca-412f-a777-fa9de0bc981c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[201edfe1-bc00-46c5-9e70-8744dead8716]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== disconnect_volume: return (260ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:57:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:57:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:57:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b8c2961-5a3e-4583-9616-1165de285bf4 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:57:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:57:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:57:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:57:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:57:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:57:53 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:57:53 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.210357666015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:57:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:57:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:57:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:57:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:57:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:57:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:57:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:57:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:58:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:58:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:58:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:58:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Triggering sync for uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 15:58:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:58:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:58:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:58:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:58:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:58:31 user nova-compute[73091]: INFO nova.compute.manager [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attaching volume d26fdedc-9e8e-400a-bf91-2182ee479be3 to /dev/vdb
Aug 16 15:58:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73fe54-9278-40b3-a093-e97487abda5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:298f735473b7\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef690ff0-4be4-4bca-865e-06c0fda58ea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b715385f-b11c-4f3c-a270-967d5ec4206c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d2ffa-0183-44ea-88c1-7e707cff5110]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 15:58:32 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 15:58:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ff0812-8d78-4248-8e00-fc6b1ec35688]: (4, '') {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:298f735473b7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:58:32 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating existing volume attachment record: 69894398-5a62-410e-bda5-697e5923583e {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 15:58:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNogXYSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:58:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:58:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:58:41 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b697a-3d08-48c5-9598-a824d8fc770e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 15:58:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e85bf-af3c-469e-954b-864d103376c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3] added\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3] added
Aug 16 15:58:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588ad33-f5de-4131-8cd7-9e3fe8103c2d]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b035d4a1-6959-47a9-86c6-cf3889afd1de]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNogXYSC {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNogXYSC" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90523ad-883b-47e5-a3bc-d34eeb7a6d4c]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNogXYSC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90fdc15-7fbe-4377-81ef-b09837335391]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f117e6-b385-4361-af62-338180fbd0a1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:58:42 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 15:58:42 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:58:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 15:58:42 user nova-compute[73091]: 
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --login {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52c4d4-98a4-40b6-a421-9e588e723d61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260]
Aug 16 15:58:42 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260] successful.
Aug 16 15:58:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f4619e-46d6-4a7d-a9c3-67f5fa39d536]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4d55b1-ac8f-4311-8e05-1b927ec683a5]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 (non-flash)
Aug 16 15:58:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 (non-flash)
Aug 16 15:58:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd6cd63-4f44-4f6f-a488-918987f026db]: (4, ('- - 0', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 15:58:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNogXYSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26464346132663834', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464346132663834', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 15:58:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:58:43 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:58:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:58:43 user nova-compute[73091]:   <serial>d26fdedc-9e8e-400a-bf91-2182ee479be3</serial>
Aug 16 15:58:43 user nova-compute[73091]: </disk>
Aug 16 15:58:43 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] No VIF found with MAC fa:16:3e:fc:11:61, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 15:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0cb5d5f6-aaf4-41f7-9b41-26559f4f78ed tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.770s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:58:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:58:46 user nova-compute[73091]: INFO nova.compute.manager [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Detaching volume d26fdedc-9e8e-400a-bf91-2182ee479be3
Aug 16 15:58:46 user nova-compute[73091]: INFO nova.virt.block_device [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Attempting to driver detach volume d26fdedc-9e8e-400a-bf91-2182ee479be3 from mountpoint /dev/vdb
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Attempting to detach device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:58:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:58:46 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:58:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:58:46 user nova-compute[73091]:   <serial>d26fdedc-9e8e-400a-bf91-2182ee479be3</serial>
Aug 16 15:58:46 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:58:46 user nova-compute[73091]: </disk>
Aug 16 15:58:46 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:58:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the persistent domain config.
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 15:58:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 15:58:46 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 15:58:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 15:58:46 user nova-compute[73091]:   <serial>d26fdedc-9e8e-400a-bf91-2182ee479be3</serial>
Aug 16 15:58:46 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 15:58:46 user nova-compute[73091]: </disk>
Aug 16 15:58:46 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f1e38e24-a281-4a63-839c-a1a5e64e443b None None] Received event <DeviceRemovedEvent: 1692201526.9814205, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 15:58:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully detached device vdb from instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 from the live domain config.
Aug 16 15:58:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f114c2d0250>, {'target_iqns': ['iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNogXYSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 15:58:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 15:58:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 15:58:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7b0d70-5859-49f1-9168-3e651bbe005f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b623c024-4f00-4863-95ef-6730242b7e66]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 (non-flash)\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 (non-flash)
Aug 16 15:58:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 (non-flash)
Aug 16 15:58:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f113c58ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc5f0e-78d9-4cb0-a74a-d558d7ec8cd1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a44ce-4264-4f4a-95a3-e87d0b384ab8]: (4, ('ok\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[568610d9-9499-4d3f-98fa-f177c3972813]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[135bdf2a-6112-44d5-87e4-e95af7968fd3]: (4, ('1', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2841183a-4a73-4b3c-b030-0e5cb720d5da]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --logout {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a85df71-4794-44d4-8ea1-e051f4ca9c54]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260]
Aug 16 15:58:47 user nova-compute[73091]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3, portal: 172.16.0.220,3260] successful.
Aug 16 15:58:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op delete {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26fdedc-9e8e-400a-bf91-2182ee479be3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84412) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d1a978-fc9a-4b75-8020-b19a2e356a60]: (4, ('', '')) {{(pid=84412) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] <== disconnect_volume: return (247ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 15:58:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'flavor' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:58:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da0a882c-1be4-43ff-a9d9-777beab94e74 tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:58:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:58:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:58:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:58:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.209308624267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:58:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:58:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:58:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:58:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:58:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:58:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:59:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 15:59:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:59:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:59:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:59:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 15:59:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:59:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 15:59:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 15:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 15:59:57 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:59:57 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.208515167236328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Instance c0560206-b5f2-4b0e-80fd-d75b570f9c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 15:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquired lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 15:59:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lazy-loading 'info_cache' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 15:59:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [{"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 15:59:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Releasing lock "refresh_cache-c0560206-b5f2-4b0e-80fd-d75b570f9c60" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 15:59:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 15:59:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:00:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:20 user nova-compute[73091]: INFO nova.compute.manager [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Terminating instance
Aug 16 16:00:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 16:00:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-b67831a9-811b-4910-803c-52c9ba8d8434 req-f26e574d-37f3-4fb9-bcbc-b2d1e89ef6da service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-unplugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b67831a9-811b-4910-803c-52c9ba8d8434 req-f26e574d-37f3-4fb9-bcbc-b2d1e89ef6da service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b67831a9-811b-4910-803c-52c9ba8d8434 req-f26e574d-37f3-4fb9-bcbc-b2d1e89ef6da service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b67831a9-811b-4910-803c-52c9ba8d8434 req-f26e574d-37f3-4fb9-bcbc-b2d1e89ef6da service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-b67831a9-811b-4910-803c-52c9ba8d8434 req-f26e574d-37f3-4fb9-bcbc-b2d1e89ef6da service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-unplugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-b67831a9-811b-4910-803c-52c9ba8d8434 req-f26e574d-37f3-4fb9-bcbc-b2d1e89ef6da service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-unplugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Instance destroyed successfully.
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lazy-loading 'resources' on Instance uuid c0560206-b5f2-4b0e-80fd-d75b570f9c60 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T15:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-917230872',display_name='tempest-SnapshotDataIntegrityTests-server-917230872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-917230872',id=53,image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYuYHVuK7uQjentA3IcK6aaU1umex+kONhlnoWjSjbbEBPs0G7fOfNDkbNujC4xuy2bmzWyArGaMpus+Eo1bLAImFikV+QG6JaPyNtI7X66kKgxh6h3zZ0CblqEG7EppA==',key_name='tempest-keypair-1950980076',keypairs=<?>,launch_index=0,launched_at=2023-08-16T15:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0bb38f33da6432bac9b014e2156c190',ramdisk_id='',reservation_id='r-f9qkui2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b18d278d-2e25-4ef6-ba90-d1af21f699be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-350461724',owner_user_name='tempest-SnapshotDataIntegrityTests-350461724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T15:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e0810f5febe41f7bbe87ebf1302c1ac',uuid=c0560206-b5f2-4b0e-80fd-d75b570f9c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Converting VIF {"id": "630f694b-0775-4437-8674-1e35c2c12e8f", "address": "fa:16:3e:fc:11:61", "network": {"id": "cbc2a6a2-0ffd-4305-b99b-6e14bb60d319", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-394369876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0bb38f33da6432bac9b014e2156c190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630f694b-07", "ovs_interfaceid": "630f694b-0775-4437-8674-1e35c2c12e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG os_vif [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap630f694b-07, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:21 user nova-compute[73091]: INFO os_vif [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:11:61,bridge_name='br-int',has_traffic_filtering=True,id=630f694b-0775-4437-8674-1e35c2c12e8f,network=Network(cbc2a6a2-0ffd-4305-b99b-6e14bb60d319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630f694b-07')
Aug 16 16:00:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Deleting instance files /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60_del
Aug 16 16:00:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Deletion of /opt/stack/data/nova/instances/c0560206-b5f2-4b0e-80fd-d75b570f9c60_del complete
Aug 16 16:00:21 user nova-compute[73091]: INFO nova.compute.manager [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 16:00:21 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 16:00:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 16:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 16:00:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Took 1.35 seconds to deallocate network for instance.
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:23 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Deleted allocations for instance c0560206-b5f2-4b0e-80fd-d75b570f9c60
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-57cc84a7-0ff8-45a6-9a9e-d88ec2a45fbe tempest-SnapshotDataIntegrityTests-350461724 tempest-SnapshotDataIntegrityTests-350461724-project-member] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:00:23 user nova-compute[73091]: WARNING nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received unexpected event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with vm_state deleted and task_state None.
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:00:23 user nova-compute[73091]: WARNING nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received unexpected event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with vm_state deleted and task_state None.
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:00:23 user nova-compute[73091]: WARNING nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received unexpected event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with vm_state deleted and task_state None.
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Acquiring lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] Lock "c0560206-b5f2-4b0e-80fd-d75b570f9c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] No waiting events found dispatching network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 16:00:23 user nova-compute[73091]: WARNING nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received unexpected event network-vif-plugged-630f694b-0775-4437-8674-1e35c2c12e8f for instance with vm_state deleted and task_state None.
Aug 16 16:00:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f803140-da6f-4d4f-a64b-76733145e753 req-75a89bf4-536d-4ea6-87b3-bbe46de8e215 service nova] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Received event network-vif-deleted-630f694b-0775-4437-8674-1e35c2c12e8f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 16:00:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692201621.6486073, c0560206-b5f2-4b0e-80fd-d75b570f9c60 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 16:00:36 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] VM Stopped (Lifecycle Event)
Aug 16 16:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-21274594-bd74-4477-9f89-81917f4c52fa None None] [instance: c0560206-b5f2-4b0e-80fd-d75b570f9c60] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:00:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:00:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:00:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:00:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 16:00:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.235679626464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 16:00:56 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed in ProviderTree for provider: de22140b-6a80-4bc1-99c6-0964e3f024fc {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 16:00:57 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Inventory has not changed for provider de22140b-6a80-4bc1-99c6-0964e3f024fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 16:00:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 16:00:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 16:00:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 16:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 16:00:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:01:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:01:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:01:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-1fcded48-5d85-4672-a3f6-630d986d0142 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 16:01:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:01:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 16:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 16:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 16:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 16:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}